-- Logs begin at Tue 2022-07-05 09:25:06 UTC, end at Tue 2022-07-05 10:38:50 UTC. -- Jul 05 10:03:44.942434 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 10:03:44.951859 dv-cinder-master-3-smb devstack@n-api.service[103343]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 10:03:44 2022] *** Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: nodename: dv-cinder-master-3-smb Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: machine: x86_64 Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: clock source: unix Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: pcre jit disabled Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: detected number of CPU cores: 4 Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: current working directory: / Jul 05 10:03:44.953838 dv-cinder-master-3-smb devstack@n-api.service[103343]: detected binary path: /usr/bin/uwsgi-core Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: your processes number limit is 47680 Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: your memory page size is 4096 bytes Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: detected max file descriptor number: 2048 Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: lock engine: pthread robust mutexes Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: thunder lock: enabled Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 10:03:44.954605 dv-cinder-master-3-smb devstack@n-api.service[103343]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 10:03:44.997891 dv-cinder-master-3-smb devstack@n-api.service[103343]: Python main interpreter initialized at 0x55d93b0b09c0 Jul 05 10:03:44.997891 dv-cinder-master-3-smb devstack@n-api.service[103343]: python threads support enabled Jul 05 10:03:44.997891 dv-cinder-master-3-smb devstack@n-api.service[103343]: your server socket listen backlog is limited to 100 connections Jul 05 10:03:44.997891 dv-cinder-master-3-smb devstack@n-api.service[103343]: your mercy for graceful operations on workers is 90 seconds Jul 05 10:03:44.998270 dv-cinder-master-3-smb devstack@n-api.service[103343]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 10:03:44.998270 dv-cinder-master-3-smb devstack@n-api.service[103343]: *** Operational MODE: preforking *** Jul 05 10:03:44.998539 dv-cinder-master-3-smb devstack@n-api.service[103343]: *** uWSGI is running in multiple interpreter mode *** Jul 05 10:03:44.998539 dv-cinder-master-3-smb devstack@n-api.service[103343]: spawned uWSGI master process (pid: 103343) Jul 05 10:03:44.998733 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Jul 05 10:03:44.999828 dv-cinder-master-3-smb devstack@n-api.service[103343]: spawned uWSGI worker 1 (pid: 103344, cores: 1) Jul 05 10:03:44.999828 dv-cinder-master-3-smb devstack@n-api.service[103343]: spawned uWSGI worker 2 (pid: 103345, cores: 1) Jul 05 10:03:44.999828 dv-cinder-master-3-smb devstack@n-api.service[103343]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 10:03:45.649827 dv-cinder-master-3-smb devstack@n-api.service[103345]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 10:03:45.652903 dv-cinder-master-3-smb devstack@n-api.service[103344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 10:03:46.758593 dv-cinder-master-3-smb devstack@n-api.service[103345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:03:46.758593 dv-cinder-master-3-smb devstack@n-api.service[103345]: from cryptography.utils import int_from_bytes Jul 05 10:03:46.759096 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:03:46.759096 dv-cinder-master-3-smb devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Jul 05 10:03:46.759096 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:03:46.759096 dv-cinder-master-3-smb devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Jul 05 10:03:46.759589 dv-cinder-master-3-smb devstack@n-api.service[103345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:03:46.759589 dv-cinder-master-3-smb devstack@n-api.service[103345]: from cryptography.utils import int_from_bytes Jul 05 10:03:49.194286 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:03:49.194934 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:03:49.195034 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:03:49.195374 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:03:49.195466 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:03:49.195562 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:03:49.195646 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:03:49.195737 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:03:49.195817 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:03:49.195905 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.195998 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:03:49.196165 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.196412 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.196547 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.196709 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.196804 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197055 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197190 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197355 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197451 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197689 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.197851 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198044 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198182 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198305 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198388 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198568 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198699 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198874 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.198991 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199173 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199264 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199486 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199586 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199787 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.199880 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200089 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200185 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200384 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200488 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200685 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.200785 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201021 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201123 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201294 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201387 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201606 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201781 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.201909 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.202236 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.202446 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.202554 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.202751 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.202839 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203073 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203180 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203379 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203575 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203697 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.203834 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204006 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204151 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204314 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204453 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204632 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204768 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.204936 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205069 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205254 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205536 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205642 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205849 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.205980 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206156 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206320 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206489 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206632 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206892 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.206992 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.207197 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.207335 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.207555 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.207700 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.207867 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208000 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208183 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208312 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208485 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208634 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208803 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.208940 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209115 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209264 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209426 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209582 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209738 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.209900 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210033 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210245 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210361 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210535 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210665 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210841 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.210976 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211147 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211289 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211463 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211552 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211765 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.211860 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212067 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212153 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212310 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212397 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212615 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212702 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.212933 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213118 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213206 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213294 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213438 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213559 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213748 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.213848 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214039 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214126 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214371 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214461 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214675 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214765 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.214974 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215062 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215272 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215378 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215571 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215666 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215869 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.215957 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216166 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216264 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216467 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216559 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216771 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.216859 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217075 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217171 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217387 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217480 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217688 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.217775 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218000 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218103 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218325 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218425 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218641 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218727 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.218943 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219039 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219264 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219351 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219572 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219670 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219868 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.219986 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220182 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220275 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220495 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220582 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220794 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.220889 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221096 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221184 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221398 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221486 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221702 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.221788 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222008 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222103 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222342 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222433 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222581 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222671 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222873 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.222965 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223196 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223291 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223503 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223590 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223799 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.223885 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224100 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224201 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224399 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224487 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224692 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224779 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.224990 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225091 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225286 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225372 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225583 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225679 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225883 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.225982 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226177 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226280 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226500 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226589 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226802 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.226901 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227097 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227202 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227395 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227486 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227696 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227791 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.227998 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228093 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228293 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228386 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228591 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228687 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228887 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.228987 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229183 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229270 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229486 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229580 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229784 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.229871 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230083 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230177 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230409 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230510 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230708 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.230805 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231005 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231093 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231311 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231398 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231608 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231697 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231909 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.231996 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232211 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232297 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232505 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232599 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232805 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.232898 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233102 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233196 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233398 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233491 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233694 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233781 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.233987 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234078 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234305 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234412 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234601 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234699 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234897 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.234983 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235189 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235294 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235486 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235589 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235778 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.235880 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236077 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236164 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236376 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236494 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236677 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236763 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.236979 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237067 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237278 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237392 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237582 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237670 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237888 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.237985 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.238205 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:03:49.238345 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.238558 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.238647 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.238917 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239016 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239247 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239338 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239574 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239662 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239889 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.239980 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240196 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240297 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240507 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240596 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240829 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.240925 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241134 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241221 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241441 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241532 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241748 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.241852 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242057 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242158 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242393 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242497 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242713 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.242824 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243021 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243116 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243333 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243422 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243646 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243744 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.243954 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244050 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244268 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244357 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244575 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244671 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244891 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.244978 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245195 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245282 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245522 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245625 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245831 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.245918 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246149 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246255 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246524 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246630 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246836 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.246935 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247160 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247247 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247479 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247577 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247791 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.247878 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248090 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248176 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248402 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248535 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248710 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.248798 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249025 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249121 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249332 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249418 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249638 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249723 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.249946 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250032 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250276 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250368 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250585 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250683 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250893 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.250990 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251207 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251295 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251515 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251601 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251820 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.251918 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252132 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252220 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252439 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252525 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252745 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.252840 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253051 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253139 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253351 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253443 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253650 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253751 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.253951 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254074 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254294 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254384 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254597 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254702 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254903 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.254989 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255207 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255293 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255506 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255592 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255830 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.255918 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256130 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256216 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256436 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256525 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256740 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.256835 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257044 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257139 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257340 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257435 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257646 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257732 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.257949 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258045 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258268 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258360 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258578 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258664 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258883 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.258982 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259184 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259279 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259500 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259586 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259803 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.259899 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260104 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260191 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260413 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260500 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260715 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.260814 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261019 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261105 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261327 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261414 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261632 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261801 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.261921 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262006 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262242 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262374 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262574 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262670 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262883 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.262969 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263203 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263290 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263503 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263597 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263821 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.263908 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264139 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264226 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264451 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264540 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264748 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.264836 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265056 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265143 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265354 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265451 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265653 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265740 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.265952 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266047 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266277 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266380 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266584 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266671 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266891 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.266987 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267192 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267286 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267493 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267580 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267795 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.267897 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268097 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268184 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268397 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268483 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268696 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268797 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.268992 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269080 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269289 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269383 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269590 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269679 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.269912 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270030 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270297 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270387 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270630 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270721 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.270943 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271032 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271259 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271354 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271568 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271658 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.271878 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272003 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272183 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272273 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272493 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272596 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272796 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.272884 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273102 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273201 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273417 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273503 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273720 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.273807 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274032 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274130 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274362 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274506 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274677 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274809 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.274978 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275127 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275293 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275427 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275591 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275725 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.275901 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276049 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276188 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276333 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276499 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276639 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276836 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.276970 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277147 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277279 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277452 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277585 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277760 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.277895 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278064 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278205 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278383 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278518 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278675 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278767 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.278972 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279105 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279285 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279417 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279590 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279728 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.279902 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280042 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280209 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280355 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280523 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280659 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280826 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.280972 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281137 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281288 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281435 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281570 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281727 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.281859 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282094 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282305 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282440 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282576 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282712 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282847 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.282990 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283135 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283270 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283407 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283546 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283682 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283851 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.283997 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284147 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284290 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284437 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284570 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284710 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.284842 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285020 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285163 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285332 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285465 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285796 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.285966 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286098 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286287 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286422 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286596 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286733 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.286899 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287035 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287181 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287318 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287465 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287600 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287770 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.287920 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288056 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288199 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288367 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288512 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288678 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288810 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.288986 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289129 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289287 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289419 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289585 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289722 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.289899 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290107 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290270 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290404 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290541 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290685 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290829 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.290973 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291107 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291244 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291379 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291516 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291670 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291818 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.291953 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292094 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292311 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292449 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292592 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292734 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.292877 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293010 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293164 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293298 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293472 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293607 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293778 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.293920 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294084 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294278 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294430 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294561 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294707 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.294803 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295017 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295105 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295322 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295409 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295627 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295714 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.295934 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296032 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296242 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296336 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296544 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296692 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296850 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.296995 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297156 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297300 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297454 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297600 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297743 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.297887 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298049 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298211 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298377 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298636 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298783 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.298967 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299232 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299385 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299565 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299655 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299878 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.299972 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300193 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300281 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300509 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300596 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300828 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.300918 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301193 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301291 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301504 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301601 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301808 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.301905 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302108 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302209 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302446 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302579 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302753 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.302861 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303053 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303152 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303353 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303449 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303653 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303748 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.303955 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304051 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304248 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304342 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304554 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304655 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304858 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.304948 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305161 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305258 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305463 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305550 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305765 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.305856 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306073 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306159 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306394 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306501 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306700 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.306799 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307000 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307086 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307299 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307396 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307596 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307682 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307893 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.307979 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308195 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308291 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308497 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308584 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308825 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.308912 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309125 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309212 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309461 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309548 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309758 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.309843 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310058 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310146 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310400 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310490 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310701 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310800 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.310999 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311088 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311295 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311381 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311595 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311680 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311894 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.311989 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312193 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312287 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312563 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312672 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312795 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.312882 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313098 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313188 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313400 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313573 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313695 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313783 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.313997 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314082 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314315 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314425 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314623 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314754 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.314923 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315009 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315220 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315322 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315517 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315606 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315814 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.315899 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316111 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316199 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316407 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316503 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316711 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.316828 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317027 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317116 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317332 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317428 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317628 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.317722 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318291 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318388 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318594 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318689 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318894 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.318983 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319200 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319289 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319499 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319593 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319807 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.319905 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320108 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320197 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320403 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320489 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320701 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.320799 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321004 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321092 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321302 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321397 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321599 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321706 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321899 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.321985 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322201 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322308 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322528 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322648 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322828 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.322925 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323133 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323230 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323432 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323521 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323732 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.323820 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324030 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324126 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324331 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324418 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324624 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324710 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.324920 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325019 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325217 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325313 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325513 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325612 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325812 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.325900 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326113 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326201 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326436 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326525 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326732 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.326831 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327033 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327122 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327345 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327439 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327628 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327724 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.327930 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328024 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328268 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328356 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328570 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328667 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328875 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.328961 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329187 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329274 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329496 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329592 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329801 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.329889 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330110 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330297 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330432 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330581 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330740 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.330893 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331045 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331197 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331353 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331512 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331653 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331823 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.331950 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332136 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332272 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332486 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332634 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332795 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.332947 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333121 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333295 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333433 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333610 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333745 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.333926 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334063 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334238 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334415 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334553 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334737 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.334860 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335040 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335165 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335349 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335469 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335773 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.335968 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336080 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336274 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336382 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336580 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336689 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336891 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.336988 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337207 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337305 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337517 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337606 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337826 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.337915 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338136 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338256 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338463 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338565 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338776 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.338864 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339077 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339164 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339376 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339471 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339675 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339762 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.339975 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340062 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340272 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340368 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340571 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340874 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.340991 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341181 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341302 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341482 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341611 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341904 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.341992 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342212 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342352 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342541 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342639 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342845 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.342943 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343150 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343248 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343447 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343534 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343758 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.343843 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344069 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344159 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344373 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344470 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344725 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.344811 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345021 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345117 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345319 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345407 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345624 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345724 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.345943 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346031 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346257 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346346 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346562 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346661 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346860 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.346949 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347164 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347250 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347464 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347564 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347763 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.347856 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348109 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348200 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348412 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348508 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348740 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.348834 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349152 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349240 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349461 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349603 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349762 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.349856 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350077 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350164 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350420 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350511 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350740 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.350833 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351039 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351126 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351347 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351436 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351652 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351753 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.351971 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352064 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352277 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352371 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352584 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352672 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352893 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.352981 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353196 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353311 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353513 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353611 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353826 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.353922 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354129 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354254 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354471 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354568 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354792 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.354895 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355105 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355223 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355425 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355516 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355778 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.355864 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356097 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356195 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356398 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356494 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356697 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.356784 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357003 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357108 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357304 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357392 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357605 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357695 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.357920 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358008 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358261 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358353 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358541 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358630 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358844 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.358932 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359147 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359234 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359445 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359540 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359750 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.359843 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360061 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360155 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360356 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360442 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360655 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360744 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.360965 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361051 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361263 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361358 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361580 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361667 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361880 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.361967 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362202 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362332 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362531 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362618 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362833 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.362921 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363132 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363243 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363430 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363520 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363810 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.363910 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364110 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364208 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364427 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364516 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364753 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.364842 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365054 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365142 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365365 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365471 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365690 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.365785 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366008 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366096 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366334 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366427 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366649 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366735 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.366970 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367061 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367274 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367363 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367575 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367885 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.367984 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368185 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368281 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368486 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368583 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368786 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.368882 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369089 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369184 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369385 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369484 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369684 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369771 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.369979 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370066 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370299 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370399 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370603 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370698 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.370911 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371008 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371217 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371313 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371510 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371598 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371811 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.371899 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372117 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372215 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372413 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372499 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372716 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.372803 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373016 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373150 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373345 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373466 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373648 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373737 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.373967 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374055 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374299 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374414 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374618 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374730 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.374928 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375023 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375256 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375349 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375545 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375653 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375855 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.375942 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376163 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376249 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376472 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376566 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376781 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.376867 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377082 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377177 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377390 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377488 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377694 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377787 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.377997 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378082 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378332 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378542 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378633 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378865 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.378953 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.379175 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.379483 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.379820 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.380134 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.380491 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.380805 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.381123 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.381435 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.381634 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.381774 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.381964 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382102 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382304 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382480 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382621 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382716 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.382936 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383024 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383250 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383347 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383563 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383652 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383876 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.383964 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384208 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384296 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384523 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384610 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384836 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.384926 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385149 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385245 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385470 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385578 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385781 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.385885 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386091 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386178 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386427 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386516 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386744 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.386846 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387055 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387147 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387365 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387452 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387672 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387760 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.387986 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388074 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388293 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388388 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388600 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388698 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.388905 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389001 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389209 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389297 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389516 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389604 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389820 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.389955 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390124 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390241 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390456 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390545 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390766 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.390854 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391085 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391187 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391396 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391482 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391720 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.391922 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392033 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392234 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392345 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392571 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392658 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.392916 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393158 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393253 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393476 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393573 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393800 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.393891 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394122 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394212 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394465 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394562 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394769 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.394879 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395134 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395237 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395451 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395612 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395762 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.395849 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396066 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396155 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396372 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396469 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396672 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396776 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.396965 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397053 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397281 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397371 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397587 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397811 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.397901 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.398159 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.398284 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.398499 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.398589 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.398824 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399026 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399134 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399369 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399457 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399678 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399783 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.399997 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400094 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400317 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400406 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400630 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400720 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.400936 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401025 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401241 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401329 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401543 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401632 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401841 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.401927 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402147 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402254 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402476 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402564 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402773 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.402860 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403071 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403167 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403374 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403470 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403679 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403811 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.403978 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404081 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404282 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404369 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404576 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404882 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.404978 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405183 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405273 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405483 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405569 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405787 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.405898 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406087 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406177 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406419 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406509 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406722 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.406824 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407028 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407126 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407328 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407417 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407637 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407725 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.407936 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408024 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408241 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408334 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408535 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408623 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408843 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.408940 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409143 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409233 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409447 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409536 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409766 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.409858 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410078 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410167 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410405 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410515 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410731 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.410818 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411042 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411210 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411347 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411435 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411665 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411761 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.411970 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412212 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412303 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412549 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412645 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412871 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.412960 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.413211 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.413413 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.413539 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.413747 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.413834 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414066 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414176 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414426 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414518 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414752 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.414847 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415056 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415153 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415360 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415449 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415661 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415797 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.415971 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416066 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416279 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416374 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416585 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416671 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416887 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.416976 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417192 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417288 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417497 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417593 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417801 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.417900 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418102 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418192 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418432 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418530 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418735 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.418823 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419046 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419136 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419354 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419453 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419650 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419738 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.419951 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420074 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420265 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420358 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420591 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420685 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420901 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.420990 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421208 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421297 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421517 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421611 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421828 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.421915 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422133 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422242 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422464 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422554 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422769 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.422870 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423072 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423162 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423381 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423469 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423703 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.423809 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424015 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424104 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424320 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424416 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424684 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.424788 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425005 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425093 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425326 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425416 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425638 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425729 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.425942 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426046 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426332 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426427 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426654 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426746 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.426963 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427051 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427278 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427375 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427586 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427677 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427901 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.427989 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428207 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428295 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428512 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428602 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428821 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.428912 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429132 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429233 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429432 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429528 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429730 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.429819 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430029 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430125 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430360 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430451 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430664 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430768 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.430960 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431057 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431258 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431344 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431558 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431645 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431856 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.431944 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432152 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432238 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432462 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432551 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432741 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.432829 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433040 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433135 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433333 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433436 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433629 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433759 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.433926 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434014 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434270 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434368 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434543 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434631 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434839 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.434934 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435139 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435235 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435435 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435521 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435729 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.435824 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436024 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436130 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436317 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436406 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436611 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436699 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.436938 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437036 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437266 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437364 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437568 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437656 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437881 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.437976 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438185 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438302 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438524 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438611 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438825 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.438915 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439138 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439228 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439445 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439532 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439749 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.439839 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440050 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440138 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440356 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440443 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440663 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440754 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.440966 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441063 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441271 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441360 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441574 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441664 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441901 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.441993 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.442206 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.442468 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.442581 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.442687 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443206 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443300 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443508 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443605 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443817 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.443911 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444131 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444220 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444488 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444594 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444747 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.444835 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445049 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445137 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445355 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445450 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445664 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445752 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.445970 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446094 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446305 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446397 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446634 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446755 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.446958 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447071 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447267 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447386 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447592 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447701 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.447915 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448012 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448258 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448346 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448569 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448657 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.448915 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449015 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449230 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449317 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449540 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449634 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449854 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.449952 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.450157 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.450270 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.450422 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:03:49.450521 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.450814 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.451121 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.451420 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:03:49.451655 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:03:49.511568 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO dbcounter [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Registered counter for database nova_api Jul 05 10:03:49.512603 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO dbcounter [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Registered counter for database nova_api Jul 05 10:03:49.627882 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.629795 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.634510 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.636772 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.689185 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.context [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=103345) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 10:03:49.691906 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.context [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=103344) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 10:03:49.693550 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:03:49.695262 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:03:49.695988 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:03:49.696173 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:03:49.697805 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:03:49.698034 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_concurrency.lockutils [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103345) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:03:49.698672 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:03:49.700057 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO dbcounter [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Registered counter for database nova_cell0 Jul 05 10:03:49.700777 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:03:49.702911 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO dbcounter [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Registered counter for database nova_cell0 Jul 05 10:03:49.703869 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO dbcounter [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Registered counter for database nova_cell1 Jul 05 10:03:49.706851 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO dbcounter [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Registered counter for database nova_cell1 Jul 05 10:03:49.712159 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.713765 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.718839 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.719600 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.720072 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.721334 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.726166 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.729076 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.865302 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO dbcounter [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Registered counter for database nova_cell0 Jul 05 10:03:49.872265 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO dbcounter [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Registered counter for database nova_cell0 Jul 05 10:03:49.874509 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG oslo_db.sqlalchemy.engines [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.879405 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:03:49.879777 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writer thread running {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:49.884232 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:03:50.213793 dv-cinder-master-3-smb devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:03:50.215298 dv-cinder-master-3-smb devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:03:50.221361 dv-cinder-master-3-smb devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:03:50.222624 dv-cinder-master-3-smb devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:03:50.571894 dv-cinder-master-3-smb devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:03:50.572900 dv-cinder-master-3-smb devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:03:50.578014 dv-cinder-master-3-smb devstack@n-api.service[103345]: WARNING keystonemiddleware.auth_token [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:03:50.579077 dv-cinder-master-3-smb devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:03:50.583398 dv-cinder-master-3-smb devstack@n-api.service[103345]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d93b0b09c0 pid: 103345 (default app) Jul 05 10:03:50.584223 dv-cinder-master-3-smb devstack@n-api.service[103344]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d93b0b09c0 pid: 103344 (default app) Jul 05 10:03:50.585501 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:03:50.586751 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-01e1db1c-1b3e-47dd-a92e-776af0092cce None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jul 05 10:03:50.587164 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Tue Jul 5 10:03:50 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:04.838349 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:04.839601 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Jul 05 10:05:04.839995 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:04.851977 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:04.852880 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell0:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:04.854088 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell1:SELECT=3 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:04.855038 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:05.286542 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-98e89d52-00fe-42f6-b9a5-48d6bffb5c7a admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:05.317140 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-98e89d52-00fe-42f6-b9a5-48d6bffb5c7a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.470822 Jul 05 10:05:05.317984 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 5 10:05:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:07.364058 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:07.365264 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-117dd29a-1b92-454c-bd99-97fe4f606a52 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001744 Jul 05 10:05:07.365763 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:07.426740 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-3e559495-0983-4bdf-93c5-480fe69dc5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "vcpus": 1, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:07.445093 dv-cinder-master-3-smb devstack@n-api.service[103345]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:05:07.445093 dv-cinder-master-3-smb devstack@n-api.service[103345]: warnings.warn(msg) Jul 05 10:05:07.476419 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-3e559495-0983-4bdf-93c5-480fe69dc5b7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104659 Jul 05 10:05:07.477548 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:07.492710 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.493604 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.494548 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.495342 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:07.706988 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-5bf68f4f-0840-45b7-b7ad-920b7924c9b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:07.709533 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:05:07.709533 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:05:07.779724 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-5bf68f4f-0840-45b7-b7ad-920b7924c9b3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293638 Jul 05 10:05:07.780511 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 5 10:05:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:09.829624 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-3e559495-0983-4bdf-93c5-480fe69dc5b7 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:09.830676 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-3e559495-0983-4bdf-93c5-480fe69dc5b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 05 10:05:09.831086 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:09.937850 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-290cabbe-ee1c-4f70-9ecb-69f57c510830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "name": "ds512M"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:09.955428 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:05:09.955428 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:05:09.975011 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-290cabbe-ee1c-4f70-9ecb-69f57c510830 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138099 Jul 05 10:05:09.975559 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:09.987536 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fef11492-e41d-47e3-a010-d14c122d3aab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:09.989118 dv-cinder-master-3-smb devstack@n-api.service[103345]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:05:09.989118 dv-cinder-master-3-smb devstack@n-api.service[103345]: warnings.warn(msg) Jul 05 10:05:10.021341 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fef11492-e41d-47e3-a010-d14c122d3aab admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037338 Jul 05 10:05:10.022566 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 5 10:05:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:05:12.082602 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-290cabbe-ee1c-4f70-9ecb-69f57c510830 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:12.084306 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-290cabbe-ee1c-4f70-9ecb-69f57c510830 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Jul 05 10:05:12.084968 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:05:12.151646 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-7acfcbe5-8b72-42d6-a7f9-d887381a5e93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "vcpus": 1, "disk": 10, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:12.171957 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-7acfcbe5-8b72-42d6-a7f9-d887381a5e93 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080697 Jul 05 10:05:12.172850 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:12.186094 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-8cc91bcb-2f3f-4c91-a0ce-f16175c672d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:12.211616 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-8cc91bcb-2f3f-4c91-a0ce-f16175c672d6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030195 Jul 05 10:05:12.212613 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 5 10:05:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:14.300559 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-7acfcbe5-8b72-42d6-a7f9-d887381a5e93 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:14.301936 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-7acfcbe5-8b72-42d6-a7f9-d887381a5e93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Jul 05 10:05:14.302423 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:14.361072 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-9b259261-d4c6-4eb2-8604-61d3cd5efc55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "name": "ds2G"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:14.379027 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-9b259261-d4c6-4eb2-8604-61d3cd5efc55 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070787 Jul 05 10:05:14.379563 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:14.391880 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-5cb63c28-8d96-4f1d-bdab-72b1041ae07f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:14.415040 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-5cb63c28-8d96-4f1d-bdab-72b1041ae07f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027004 Jul 05 10:05:14.415615 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 5 10:05:14 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:16.442426 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-9b259261-d4c6-4eb2-8604-61d3cd5efc55 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:16.443839 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-9b259261-d4c6-4eb2-8604-61d3cd5efc55 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jul 05 10:05:16.444212 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:16.504422 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:16.522277 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071781 Jul 05 10:05:16.526411 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:16.534460 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d69521b7-2661-48e8-a26c-9654a16fbcd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:16.559659 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d69521b7-2661-48e8-a26c-9654a16fbcd7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028875 Jul 05 10:05:16.560826 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1335 bytes} [Tue Jul 5 10:05:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:05:18.629500 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:18.630706 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 05 10:05:18.631108 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:18.690968 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-30b38e3c-05f1-4f55-91b3-c26e25b108f0 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:18.713791 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-30b38e3c-05f1-4f55-91b3-c26e25b108f0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076340 Jul 05 10:05:18.714567 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 5 10:05:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:20.774700 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:20.775721 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-84a80009-21e7-4c55-b148-0654fb20ebd7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 05 10:05:20.776130 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:20.841639 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-66cbc61a-dbe2-4923-aa54-78f049d32f4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:20.863554 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-66cbc61a-dbe2-4923-aa54-78f049d32f4a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081342 Jul 05 10:05:20.864623 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:20.877292 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-2e2cbe98-b14e-4e81-b684-0affa9aa353b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:20.901990 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-2e2cbe98-b14e-4e81-b684-0affa9aa353b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028476 Jul 05 10:05:20.902482 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 5 10:05:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:05:22.974845 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-66cbc61a-dbe2-4923-aa54-78f049d32f4a admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:22.976321 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-66cbc61a-dbe2-4923-aa54-78f049d32f4a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Jul 05 10:05:22.976806 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:23.038613 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-e7c9b331-b337-4ab7-bef1-b7b53a32beac admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:23.066588 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-e7c9b331-b337-4ab7-bef1-b7b53a32beac admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083222 Jul 05 10:05:23.067338 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:23.080578 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-b9a8fc5c-a3f8-464d-b5cd-889762fe843a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:23.116475 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-b9a8fc5c-a3f8-464d-b5cd-889762fe843a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040504 Jul 05 10:05:23.117332 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 5 10:05:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:25.187551 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-e7c9b331-b337-4ab7-bef1-b7b53a32beac admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:25.189153 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-e7c9b331-b337-4ab7-bef1-b7b53a32beac admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 05 10:05:25.189663 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:25.256153 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-71de73d1-e2d7-4795-9a7e-a3e2c7bb9e04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "swap": 0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:25.274845 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-71de73d1-e2d7-4795-9a7e-a3e2c7bb9e04 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079220 Jul 05 10:05:25.275417 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:25.289893 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-ecd46cb5-f6b0-4b23-959d-b4973aa225dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:25.318775 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-ecd46cb5-f6b0-4b23-959d-b4973aa225dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034320 Jul 05 10:05:25.324915 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 5 10:05:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:27.422959 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-71de73d1-e2d7-4795-9a7e-a3e2c7bb9e04 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:27.424047 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-71de73d1-e2d7-4795-9a7e-a3e2c7bb9e04 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jul 05 10:05:27.424642 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:27.486304 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-82a235fd-b5b5-400e-b59d-d2a769c03720 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:27.505905 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-82a235fd-b5b5-400e-b59d-d2a769c03720 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075510 Jul 05 10:05:27.506584 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:27.518777 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-c9b85019-59ff-4089-8ddd-84d48d4177ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:27.541266 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-c9b85019-59ff-4089-8ddd-84d48d4177ad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026160 Jul 05 10:05:27.541803 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 5 10:05:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:29.592713 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-82a235fd-b5b5-400e-b59d-d2a769c03720 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:29.593728 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-82a235fd-b5b5-400e-b59d-d2a769c03720 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 05 10:05:29.594134 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:29.652335 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "swap": 0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:29.678369 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077493 Jul 05 10:05:29.679267 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1282 bytes} [Tue Jul 5 10:05:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:29.691977 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-e6745225-1d5d-41ae-a8f9-11486d63b61c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:29.716529 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-e6745225-1d5d-41ae-a8f9-11486d63b61c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028452 Jul 05 10:05:29.730252 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1332 bytes} [Tue Jul 5 10:05:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:05:54.063677 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:54.064695 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 05 10:05:54.065104 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:54.078861 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:54.134991 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4658f119-321f-4dc6-a796-98dd94e01594 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:54.152395 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-4658f119-321f-4dc6-a796-98dd94e01594 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.080675 Jul 05 10:05:54.152952 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 5 10:05:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:55.095011 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:55.096090 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-7d504c27-0acc-4423-ac3f-8789df6ed066 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 05 10:05:55.096490 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:55.292563 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-8748e5ed-e54e-4d15-ad66-025901508505 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:55.298262 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-8748e5ed-e54e-4d15-ad66-025901508505 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-8748e5ed-e54e-4d15-ad66-025901508505 admin admin] Request method failure captured: Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept: application/json Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Connection: keep-alive Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Content-Length: 0 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Host: 10.222.0.16 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-System-Scope: None Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: User-Agent: python-novaclient Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Auth-Token: gAAAAABixA0D8lR3ceDuHPVNc-1KyPqXKgyorYN7h7Z25E4XqhcR9xGtmPFY74d59ktSEqSx2-O7f78Mecj0rDPCFnCnjP63_Y0J-t4vZ1NqJxkX4C4SueZgSh4-2YOhTstyuOnXzupWMu_N1KfiWdtXeiQf4PdrkyAQt_HFhdBHifrFCE_Vgyw Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Id: None Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Name: None Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Identity-Status: Confirmed Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Is-Admin-Project: True Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Id: default Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Name: Default Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Name: admin Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Role: member,admin,reader Jul 05 10:05:55.301496 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Roles: member,admin,reader Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant: admin Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Name: admin Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User: admin Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Id: default Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Name: Default Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Name: admin Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: method: > Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: exception: Flavor 42 could not be found. Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: action_args: {'id': '42'} Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:55.303162 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:55.306551 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.307977 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-8748e5ed-e54e-4d15-ad66-025901508505 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:55.309122 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-8748e5ed-e54e-4d15-ad66-025901508505 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065761 Jul 05 10:05:55.309122 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 5 10:05:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 10:05:55.313151 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-fbd543ce-899b-4262-83af-a1e6003ac446 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:55.316266 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:05:55.336360 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-fbd543ce-899b-4262-83af-a1e6003ac446 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026816 Jul 05 10:05:55.336921 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:05:55.347480 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-37443ee6-ec69-426f-aee5-a723c9197e66 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:55.369099 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-37443ee6-ec69-426f-aee5-a723c9197e66 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025870 Jul 05 10:05:55.369649 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:55.381924 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0d918d44-e3e5-4b29-9a25-c45b246cbc2b admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:55.391804 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-0d918d44-e3e5-4b29-9a25-c45b246cbc2b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0d918d44-e3e5-4b29-9a25-c45b246cbc2b admin admin] Request method failure captured: Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept: application/json Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Connection: keep-alive Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Content-Length: 0 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Host: 10.222.0.16 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Auth-Token: gAAAAABixA0D8lR3ceDuHPVNc-1KyPqXKgyorYN7h7Z25E4XqhcR9xGtmPFY74d59ktSEqSx2-O7f78Mecj0rDPCFnCnjP63_Y0J-t4vZ1NqJxkX4C4SueZgSh4-2YOhTstyuOnXzupWMu_N1KfiWdtXeiQf4PdrkyAQt_HFhdBHifrFCE_Vgyw Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Id: None Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Name: None Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Name: admin Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Role: member,admin,reader Jul 05 10:05:55.397232 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Roles: member,admin,reader Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant: admin Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User: admin Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Name: admin Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: method: > Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: exception: Flavor 42 could not be found. Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: action_args: {'id': '42'} Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:55.398782 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:55.399735 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:55.400792 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0d918d44-e3e5-4b29-9a25-c45b246cbc2b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:55.401817 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-0d918d44-e3e5-4b29-9a25-c45b246cbc2b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022858 Jul 05 10:05:55.401817 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 5 10:05:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 05 10:05:56.246442 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-37443ee6-ec69-426f-aee5-a723c9197e66 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:56.247466 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-37443ee6-ec69-426f-aee5-a723c9197e66 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 05 10:05:56.247892 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:56.458285 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-033f6f62-340e-496b-b3ee-2ef820db7d97 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:56.464429 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-033f6f62-340e-496b-b3ee-2ef820db7d97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-033f6f62-340e-496b-b3ee-2ef820db7d97 admin admin] Request method failure captured: Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept: application/json Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Connection: keep-alive Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Content-Length: 0 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Host: 10.222.0.16 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Auth-Token: gAAAAABixA0E7mtuEAGg0bGw4i8JKyyUcpBaYKIBi5d9M0juhqNTqWSD0e9rlOByJjHF_wQgGoFTlHl_jCSZhBLWSS9X_6gjumQJZk4E0fJ7h1Q9TXnDk4fVJXCsS062QdD6StQgsQxg5o8Ygi7HKO_dpFcbOfXArRdwb2xSpfcnGSnfRdPSf4w Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Id: None Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Name: None Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Name: admin Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Role: member,admin,reader Jul 05 10:05:56.465986 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Roles: member,admin,reader Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant: admin Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User: admin Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Name: admin Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: method: > Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: exception: Flavor 84 could not be found. Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: action_args: {'id': '84'} Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:56.467558 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:56.468583 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.469931 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-033f6f62-340e-496b-b3ee-2ef820db7d97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:56.471282 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-033f6f62-340e-496b-b3ee-2ef820db7d97 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076166 Jul 05 10:05:56.471282 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 5 10:05:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 10:05:56.477607 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-5e89a86f-abd0-4b6b-a554-1daca98871b4 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:56.492292 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-5e89a86f-abd0-4b6b-a554-1daca98871b4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018353 Jul 05 10:05:56.492846 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:56.502817 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-92cd26ff-3100-44d1-b183-99911813d38d admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:56.517306 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-92cd26ff-3100-44d1-b183-99911813d38d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018121 Jul 05 10:05:56.517852 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:05:56.527528 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4ff0d9df-2e77-4911-90ee-e58c0147a197 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:56.533147 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-4ff0d9df-2e77-4911-90ee-e58c0147a197 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4ff0d9df-2e77-4911-90ee-e58c0147a197 admin admin] Request method failure captured: Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept: application/json Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Connection: keep-alive Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Content-Length: 0 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Host: 10.222.0.16 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-System-Scope: None Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: User-Agent: python-novaclient Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Auth-Token: gAAAAABixA0E7mtuEAGg0bGw4i8JKyyUcpBaYKIBi5d9M0juhqNTqWSD0e9rlOByJjHF_wQgGoFTlHl_jCSZhBLWSS9X_6gjumQJZk4E0fJ7h1Q9TXnDk4fVJXCsS062QdD6StQgsQxg5o8Ygi7HKO_dpFcbOfXArRdwb2xSpfcnGSnfRdPSf4w Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Id: None Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Name: None Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Identity-Status: Confirmed Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Is-Admin-Project: True Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Id: default Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Name: Default Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Name: admin Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Role: member,admin,reader Jul 05 10:05:56.534692 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Roles: member,admin,reader Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant: admin Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Name: admin Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User: admin Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Id: default Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Name: Default Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Name: admin Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: method: > Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: exception: Flavor 84 could not be found. Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: action_args: {'id': '84'} Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:56.536198 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:56.537146 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:56.538483 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4ff0d9df-2e77-4911-90ee-e58c0147a197 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:56.539721 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-4ff0d9df-2e77-4911-90ee-e58c0147a197 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012145 Jul 05 10:05:56.539721 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Tue Jul 5 10:05:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 10:05:57.382711 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-92cd26ff-3100-44d1-b183-99911813d38d admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:57.384115 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-92cd26ff-3100-44d1-b183-99911813d38d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Jul 05 10:05:57.384525 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:57.580101 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4fcb7c62-5b2d-464b-86f1-d6861ceecbd8 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:57.585882 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.wsgi [None req-4fcb7c62-5b2d-464b-86f1-d6861ceecbd8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4fcb7c62-5b2d-464b-86f1-d6861ceecbd8 admin admin] Request method failure captured: Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept: application/json Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Accept-Encoding: gzip, deflate Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Connection: keep-alive Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Content-Length: 0 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Host: 10.222.0.16 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: Openstack-System-Scope: None Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: User-Agent: python-novaclient Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Auth-Token: gAAAAABixA0F1gitUJETxggjpr5b4KQjwLdHnKa0jWj0WpJdznZxPTuPkPPOShIjueX_KjyItZqhP8E9LSYRtaXKZaGiciKyCA8Ea-ycFvWUbSpso4AJ9IVqZFsD1D4DEm3dBTn49yjFoQo9a-tsl3_Ihr8lrwfWd_omhjUvZEKy-fBMhZBzaMM Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Id: None Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Domain-Name: None Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Identity-Status: Confirmed Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Is-Admin-Project: True Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Id: default Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Domain-Name: Default Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Project-Name: admin Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Role: member,admin,reader Jul 05 10:05:57.587428 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Roles: member,admin,reader Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant: admin Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-Tenant-Name: admin Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User: admin Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Id: default Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Domain-Name: Default Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: X-User-Name: admin Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: method: > Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: exception: Flavor 451 could not be found. Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: action_args: {'id': '451'} Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:57.588894 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:57.589742 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.590837 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-4fcb7c62-5b2d-464b-86f1-d6861ceecbd8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103345) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:57.591884 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-4fcb7c62-5b2d-464b-86f1-d6861ceecbd8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066123 Jul 05 10:05:57.591884 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:05:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 10:05:57.599120 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-5ec88d84-7e36-42be-a67a-96868bec5d06 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:57.613126 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-5ec88d84-7e36-42be-a67a-96868bec5d06 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017811 Jul 05 10:05:57.613664 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:57.625936 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:57.641202 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021143 Jul 05 10:05:57.641749 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Tue Jul 5 10:05:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:05:57.651418 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-839844d1-f77f-42e3-937a-700e7c89ca83 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:57.657186 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-839844d1-f77f-42e3-937a-700e7c89ca83 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-839844d1-f77f-42e3-937a-700e7c89ca83 admin admin] Request method failure captured: Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept: application/json Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Connection: keep-alive Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Content-Length: 0 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Host: 10.222.0.16 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Auth-Token: gAAAAABixA0F1gitUJETxggjpr5b4KQjwLdHnKa0jWj0WpJdznZxPTuPkPPOShIjueX_KjyItZqhP8E9LSYRtaXKZaGiciKyCA8Ea-ycFvWUbSpso4AJ9IVqZFsD1D4DEm3dBTn49yjFoQo9a-tsl3_Ihr8lrwfWd_omhjUvZEKy-fBMhZBzaMM Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Id: None Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Domain-Name: None Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Project-Name: admin Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Role: member,admin,reader Jul 05 10:05:57.658725 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Roles: member,admin,reader Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/95874cd0621e46bbbfb452bfbd474389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant: admin Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Id: 95874cd0621e46bbbfb452bfbd474389 Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User: admin Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Id: c042e1f397444e8991d3f0b7bfb28908 Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: X-User-Name: admin Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: method: > Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: exception: Flavor 451 could not be found. Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: action_args: {'id': '451'} Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:05:57.660170 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:57.661026 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 05 10:05:57.662202 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-839844d1-f77f-42e3-937a-700e7c89ca83 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:05:57.663507 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-839844d1-f77f-42e3-937a-700e7c89ca83 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012315 Jul 05 10:05:57.663507 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:05:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 05 10:05:58.500736 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:58.501773 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 05 10:05:58.502156 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:58.703694 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-cca4cfea-f578-4f9d-a002-89cee754269a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:58.726416 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-cca4cfea-f578-4f9d-a002-89cee754269a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.084839 Jul 05 10:05:58.726982 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 5 10:05:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:05:59.539488 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:05:59.540489 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 05 10:05:59.540904 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:05:59.739609 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-050e61fc-1995-4f36-9e87-97deb188ce7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:05:59.759262 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-050e61fc-1995-4f36-9e87-97deb188ce7d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.082794 Jul 05 10:05:59.759819 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 5 10:05:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 10:06:00.571667 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:00.572697 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 05 10:06:00.573084 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:06:00.778347 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-3efd03b0-4965-42f0-8fa8-792559743db5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:06:00.797870 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-3efd03b0-4965-42f0-8fa8-792559743db5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086503 Jul 05 10:06:00.798464 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 5 10:06:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 10:06:01.633552 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:01.634592 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 05 10:06:01.634981 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:06:01.835784 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-932dfbb8-3b11-43af-8848-5053ffec6729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:06:01.855010 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-932dfbb8-3b11-43af-8848-5053ffec6729 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081547 Jul 05 10:06:01.855548 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Tue Jul 5 10:06:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:06:02.672618 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:02.673616 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 05 10:06:02.674058 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:06:02.865251 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-01c54bdd-d4c3-4da4-bcf6-3c5ad17fa9ce admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:02.886902 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-01c54bdd-d4c3-4da4-bcf6-3c5ad17fa9ce admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077430 Jul 05 10:06:02.887356 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Tue Jul 5 10:06:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:06:49.525556 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.526814 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-fb9b5c84-bd6f-4632-a072-e641e9ee830f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Jul 05 10:06:49.527290 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 930 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:06:49.537889 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:49.590639 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-63b12ecb-a32d-4b9e-a8f1-e55da346249b admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.611956 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-63b12ecb-a32d-4b9e-a8f1-e55da346249b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078598 Jul 05 10:06:49.612488 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1291 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:06:49.635898 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-210544b9-8cac-4b59-a627-1b9064d57627 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.639360 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG dbcounter [-] [103345] Writing DB stats nova_api:SELECT=14 {{(pid=103345) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:06:49.644938 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-210544b9-8cac-4b59-a627-1b9064d57627 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012675 Jul 05 10:06:49.645450 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:06:49.656804 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d65eb518-2a16-4112-8f7f-e10642dbdc27 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.664652 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d65eb518-2a16-4112-8f7f-e10642dbdc27 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011368 Jul 05 10:06:49.665171 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:06:49.681154 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.689441 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012880 Jul 05 10:06:49.689971 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1285 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:06:49.704636 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-5d6cf410-d45a-4c1f-be3c-a3b305110052 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:06:49.717094 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-5d6cf410-d45a-4c1f-be3c-a3b305110052 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018294 Jul 05 10:06:49.717904 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1282 bytes} [Tue Jul 5 10:06:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:10:14.693554 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:14.694593 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 05 10:10:14.694951 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:10:14.833983 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=6 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:14.962594 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:14.964114 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:14.964114 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:10:14.965336 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:14.965801 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:14.966606 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:14.967027 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:15.000095 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-0be521a4-4051-42d4-963c-c34c62999a0f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.168824 Jul 05 10:10:15.000647 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:10:14 2022] GET /compute/v2.1/os-services => generated 785 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:10:15.821267 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:15.822289 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 05 10:10:15.822702 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:10:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:10:16.039503 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:16.040667 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:16.040667 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:10:16.041848 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:16.042312 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:16.043085 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:16.043501 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:16.062147 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-c87d260c-14e0-45c8-857d-3a5e05b3bb54 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.90 time: 0.097836 Jul 05 10:10:16.062711 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:10:15 2022] GET /compute/v2.1/os-services => generated 785 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:10:27.308936 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:27.309949 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 05 10:10:27.310370 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:10:27.454934 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:27.455977 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:27.456972 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=8 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:10:27.520365 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:27.521499 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:27.521499 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:10:27.522760 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:27.523200 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:27.523982 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:27.524431 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:27.548979 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-35b4733e-783e-4a87-85d6-aeb6b655484f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.101628 Jul 05 10:10:27.549536 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:10:27 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:10:28.385977 dv-cinder-master-3-smb devstack@n-api.service[103345]: DEBUG nova.api.openstack.wsgi [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] Calling method '>' {{(pid=103345) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:28.387031 dv-cinder-master-3-smb devstack@n-api.service[103345]: INFO nova.api.openstack.requestlog [None req-0918fbef-082a-4ab0-b9bc-653204dccae6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 05 10:10:28.387483 dv-cinder-master-3-smb devstack@n-api.service[103345]: [pid: 103345|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Tue Jul 5 10:10:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:10:28.586727 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:10:28.588740 dv-cinder-master-3-smb devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 10:10:28.588740 dv-cinder-master-3-smb devstack@n-api.service[103344]: warnings.warn(msg) Jul 05 10:10:28.590657 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:28.591287 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:28.592463 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:10:28.593065 dv-cinder-master-3-smb devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:10:28.616163 dv-cinder-master-3-smb devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-492e984a-8a38-4054-b320-8a5ab2eab6ae admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.90 time: 0.090794 Jul 05 10:10:28.616702 dv-cinder-master-3-smb devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Tue Jul 5 10:10:28 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:11:32.912581 dv-cinder-master-3-smb devstack@n-api.service[103343]: Tue Jul 5 10:11:32 2022 - graceful shutdown triggered... Jul 05 10:11:32.912342 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Jul 05 10:11:32.913626 dv-cinder-master-3-smb devstack@n-api.service[103344]: Gracefully killing worker 1 (pid: 103344)... Jul 05 10:11:32.914553 dv-cinder-master-3-smb devstack@n-api.service[103345]: Gracefully killing worker 2 (pid: 103345)... Jul 05 10:11:33.913576 dv-cinder-master-3-smb devstack@n-api.service[103343]: worker 1 buried after 1 seconds Jul 05 10:11:33.913576 dv-cinder-master-3-smb devstack@n-api.service[103343]: worker 2 buried after 1 seconds Jul 05 10:11:33.913576 dv-cinder-master-3-smb devstack@n-api.service[103343]: goodbye to uWSGI. Jul 05 10:11:33.916235 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Jul 05 10:11:33.917144 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Jul 05 10:11:33.921965 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Jul 05 10:11:33.940165 dv-cinder-master-3-smb devstack@n-api.service[117851]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 10:11:33 2022] *** Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: nodename: dv-cinder-master-3-smb Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: machine: x86_64 Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: clock source: unix Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: pcre jit disabled Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: detected number of CPU cores: 4 Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: current working directory: / Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: detected binary path: /usr/bin/uwsgi-core Jul 05 10:11:33.942612 dv-cinder-master-3-smb devstack@n-api.service[117851]: your processes number limit is 47680 Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: your memory page size is 4096 bytes Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: detected max file descriptor number: 2048 Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: lock engine: pthread robust mutexes Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: thunder lock: enabled Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 05 10:11:33.943414 dv-cinder-master-3-smb devstack@n-api.service[117851]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 10:11:33.987481 dv-cinder-master-3-smb devstack@n-api.service[117851]: Python main interpreter initialized at 0x55b69ef1a9c0 Jul 05 10:11:33.987481 dv-cinder-master-3-smb devstack@n-api.service[117851]: python threads support enabled Jul 05 10:11:33.987481 dv-cinder-master-3-smb devstack@n-api.service[117851]: your server socket listen backlog is limited to 100 connections Jul 05 10:11:33.987481 dv-cinder-master-3-smb devstack@n-api.service[117851]: your mercy for graceful operations on workers is 90 seconds Jul 05 10:11:33.987944 dv-cinder-master-3-smb devstack@n-api.service[117851]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 10:11:33.987944 dv-cinder-master-3-smb devstack@n-api.service[117851]: *** Operational MODE: preforking *** Jul 05 10:11:33.988228 dv-cinder-master-3-smb devstack@n-api.service[117851]: *** uWSGI is running in multiple interpreter mode *** Jul 05 10:11:33.988228 dv-cinder-master-3-smb devstack@n-api.service[117851]: spawned uWSGI master process (pid: 117851) Jul 05 10:11:33.988455 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Jul 05 10:11:33.991765 dv-cinder-master-3-smb devstack@n-api.service[117851]: spawned uWSGI worker 1 (pid: 117864, cores: 1) Jul 05 10:11:33.991765 dv-cinder-master-3-smb devstack@n-api.service[117851]: spawned uWSGI worker 2 (pid: 117865, cores: 1) Jul 05 10:11:33.991765 dv-cinder-master-3-smb devstack@n-api.service[117851]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 10:11:34.633346 dv-cinder-master-3-smb devstack@n-api.service[117864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 10:11:34.637112 dv-cinder-master-3-smb devstack@n-api.service[117865]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 05 10:11:35.803585 dv-cinder-master-3-smb devstack@n-api.service[117864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:11:35.803585 dv-cinder-master-3-smb devstack@n-api.service[117864]: from cryptography.utils import int_from_bytes Jul 05 10:11:35.804255 dv-cinder-master-3-smb devstack@n-api.service[117864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:11:35.804255 dv-cinder-master-3-smb devstack@n-api.service[117864]: from cryptography.utils import int_from_bytes Jul 05 10:11:35.812926 dv-cinder-master-3-smb devstack@n-api.service[117865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:11:35.812926 dv-cinder-master-3-smb devstack@n-api.service[117865]: from cryptography.utils import int_from_bytes Jul 05 10:11:35.813445 dv-cinder-master-3-smb devstack@n-api.service[117865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 10:11:35.813445 dv-cinder-master-3-smb devstack@n-api.service[117865]: from cryptography.utils import int_from_bytes Jul 05 10:11:38.077122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:11:38.077732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:11:38.077983 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:11:38.078302 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:11:38.078565 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:11:38.078964 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.079292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.079614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.079934 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.080267 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.080579 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.080901 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.081222 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.081551 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.081810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.082128 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.082480 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.082808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.083120 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.083431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.083753 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.084056 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.084378 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.084686 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.085199 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.086633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.086633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.086633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.086918 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.087547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.087853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.088181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.088492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.088828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.089140 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.089535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.089846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.090171 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.090496 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.090908 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.091219 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.091571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.091872 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.092202 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.092513 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.092836 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.093158 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.093475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.093795 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.094103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.094463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.094816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.095077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.095384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.095693 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.095942 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.096253 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.096577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.096900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.097225 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.097478 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.097728 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.098050 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.098398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.098714 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.099020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.099327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.099633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.099939 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.100252 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.100554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.100860 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.101179 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.101495 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.101817 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.102124 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.102472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.102878 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.103130 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.103437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.103782 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.104099 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.104406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.104729 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.105064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.105360 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.105526 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 10:11:38.106031 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.106188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 10:11:38.106366 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.106517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 10:11:38.106664 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.106664 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.106947 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 10:11:38.106947 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 10:11:38.107296 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.107296 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.107583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.107746 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.107898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108344 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108502 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108825 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.108974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109119 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109269 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109415 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109715 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.109863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.110007 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.110151 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.110325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.110766 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.110924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111072 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111375 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111521 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111672 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111817 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.111957 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112241 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112396 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112692 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112839 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.112986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113125 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113290 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113727 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.113950 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.114103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.114370 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.114527 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.114677 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.114925 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.115160 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.115322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.115574 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.115730 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.115885 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116033 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116476 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116622 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.116854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117131 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117430 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.117884 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.118790 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120205 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120442 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120532 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120804 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120895 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.120989 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121278 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121364 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121456 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121456 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121721 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.121990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122081 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122175 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122297 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122566 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122655 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122750 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.122842 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.122926 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.123102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.123363 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123456 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.123560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.123799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.123990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.124219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.124373 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.124537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.124696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.124848 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.125103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.125333 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.125481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.125722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.125879 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.126026 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.126173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.126342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.126508 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.126659 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.126812 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.126961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.126961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.127316 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.127467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.127615 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.127769 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.127907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.128054 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.128192 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.128339 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.128496 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.128643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.128789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.128928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.129074 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.129213 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.129364 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.129512 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.129658 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.129803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.129950 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.130096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.130284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.130432 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.130579 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.130718 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.130864 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.131165 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.131415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.131621 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.131764 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.131906 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.132045 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.132193 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.132339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.132494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.132633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.132771 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.132916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.133064 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.133212 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.133351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.133495 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.133640 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.133778 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.133929 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.134076 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.134354 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.134527 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.134668 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.134815 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.134955 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.135119 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.135365 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.135573 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.135736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.135971 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.136118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.136265 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.136410 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.136410 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.136691 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.136851 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.136993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.137140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.137301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.137514 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.137664 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.137814 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.137959 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.138098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.138257 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.138401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.138612 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.138773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.138913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.139051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.139196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.139334 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.139481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.139626 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.139777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.139916 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.140062 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.140201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.140352 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.140503 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.140649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.140787 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.140935 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.141074 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.141401 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.141636 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.141849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.142002 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.142208 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.142425 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.142564 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.142713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.142873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.143021 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.143169 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.143308 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.143447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.143596 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.143759 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.144017 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.144171 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.144318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.144546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.144691 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.144829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.144981 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.145133 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.145274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.145517 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.145744 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.145895 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.146149 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.146316 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.146457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.146597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.146736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.146894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.147048 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.147205 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.147345 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.147501 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.147707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.147850 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.147998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.148148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.148295 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.148434 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.148579 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.148720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.148867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.149024 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.149164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.149309 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.149448 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.149600 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.149754 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.149900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.150046 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.150185 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.150401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.150559 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.150701 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 10:11:38.150840 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.150994 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.151141 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.151403 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.151559 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.151782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152002 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152308 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152448 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152745 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.152893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153319 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153458 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153596 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153745 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.153893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154308 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154464 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154680 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154830 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.154970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.155127 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.155279 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.155435 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.155673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.155896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156049 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156291 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156715 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.156858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157009 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157163 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157459 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.157965 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158120 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158310 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158455 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158604 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158751 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.158899 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159047 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159505 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159653 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.159945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160086 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160226 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160375 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160521 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160669 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.160945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.161083 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.161239 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.161403 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.161626 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.161789 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.162011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.162243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.162588 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.162740 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.162894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163041 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163328 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163478 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163616 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.163905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164043 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164416 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164575 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.164934 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165081 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165532 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.165929 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166313 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166541 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166695 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166840 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.166989 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167275 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167564 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167728 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.167945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168098 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168239 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168378 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168526 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168813 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.168958 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169244 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169681 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.169888 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170384 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170533 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170680 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170819 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.170958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171105 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171286 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171595 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171817 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.171987 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.172292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.172536 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.173639 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.173801 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.173958 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.174106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.174352 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.174594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.174748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.174988 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.175153 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.175294 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.175443 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.175583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.175735 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176004 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176390 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176813 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.176983 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177131 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177297 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.177937 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.178166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.178388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.178544 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.178697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.178851 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179155 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179660 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179821 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.179974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180129 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180429 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180580 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180735 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.180881 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181025 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181331 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181650 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.181814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.182040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.182210 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.182461 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.182705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.182877 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183032 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183333 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183489 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.183959 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.184979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.185201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.185398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.185552 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.185924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186206 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186476 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186570 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186661 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186760 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186863 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.186947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187031 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187215 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187822 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.187996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188085 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188183 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188280 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188365 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188448 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188786 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.188962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189059 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189150 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189505 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189589 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189672 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189763 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189763 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.189933 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190303 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190395 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190667 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190764 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.190939 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191118 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191291 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191384 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191564 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191655 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191912 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.191993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192192 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192370 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.192931 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193026 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193289 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193289 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193457 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193887 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.193969 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194247 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194343 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194510 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194593 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194784 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.194870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195037 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195121 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195226 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195335 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195484 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195661 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195751 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.195843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196122 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196432 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.196996 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197094 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197300 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197685 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.197948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198300 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198605 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198818 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.198908 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199211 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199430 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.199837 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200138 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200351 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200450 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200658 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200756 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.200986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201078 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201317 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201415 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.201927 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202093 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202365 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202567 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202675 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.202988 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203291 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203510 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203608 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203813 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.203917 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204209 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204425 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204524 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204726 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.204831 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205029 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205115 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205336 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205434 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205658 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205750 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.205972 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206075 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206309 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206417 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206620 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206708 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.206924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207004 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207230 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207534 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207646 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207862 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.207965 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208141 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208241 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208446 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208545 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208755 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.208854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.209058 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.209229 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.209363 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.209690 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210007 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210177 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210335 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210640 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210721 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.210946 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211249 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211337 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211677 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211903 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.211990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.212532 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.212619 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.212863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.212982 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213258 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213477 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213788 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.213878 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214183 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214433 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214528 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.214840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215065 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215155 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215465 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215683 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215770 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.215988 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216083 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216445 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216637 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216762 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.216981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.217201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.217284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.217516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.217605 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.217962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218054 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218207 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218323 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218542 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218631 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.218948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219164 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219587 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219780 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.219869 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220709 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.220807 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221106 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221627 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221732 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.221941 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222263 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222463 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.222919 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223348 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223480 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223581 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223837 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.223927 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224133 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224448 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224554 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224750 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.224847 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225184 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225273 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225495 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225801 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.225888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226104 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226193 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226457 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226740 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.226841 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227218 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227380 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.227857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228225 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228532 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228747 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.228840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229073 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229195 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229366 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229469 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229677 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229776 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.229981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230313 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230420 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.230926 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231032 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231318 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231546 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231644 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231850 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.231963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232155 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232277 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232564 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232671 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232879 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.232978 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233503 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233631 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233829 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.233935 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234142 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234487 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234795 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.234889 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235204 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235503 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235718 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.235816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236027 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236670 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236772 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.236974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237385 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237593 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237691 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.237994 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238213 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238543 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238845 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.238938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239154 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239288 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239461 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239620 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239804 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.239890 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240114 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240215 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240441 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.240846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241162 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241370 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241460 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241674 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241763 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.241977 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242068 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242332 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242438 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242731 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.242954 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243053 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243267 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243358 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243686 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.243983 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244189 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244503 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.244900 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245123 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245212 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245750 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.245853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246714 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.246832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247024 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247123 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247435 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247635 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247730 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.247989 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248634 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248726 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.248945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249035 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249263 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249386 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249575 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249885 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.249966 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.250194 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.250297 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.250549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.250700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.250867 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.251055 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.251187 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252133 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252246 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252328 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252566 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252637 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252708 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252780 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252864 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.252937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253015 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253209 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253536 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253651 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253838 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.253936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.254987 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255174 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255340 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255418 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255418 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255626 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255698 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255776 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.255847 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256141 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256233 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256393 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256695 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.256803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257008 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257317 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.257908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258282 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258503 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258596 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.258980 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259296 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259616 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259693 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259773 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.259911 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260218 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260802 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.260974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261290 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261380 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261595 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261686 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.261902 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262208 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262634 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.262961 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.263184 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.263422 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.263632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.263778 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.263949 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264259 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264391 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264681 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264772 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.264993 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265302 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265399 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.265924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266034 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266279 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266566 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266658 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266879 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.266976 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267513 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267611 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267842 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.267934 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268153 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268239 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268774 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.268877 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269182 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269512 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269727 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.269829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270145 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270385 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270492 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270704 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.270791 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271653 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.271746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272004 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272097 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272413 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272715 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.272936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273024 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273551 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273642 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273864 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.273961 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274178 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274530 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274840 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.274945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275236 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275556 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.275974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276287 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276405 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276620 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.276944 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277043 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277271 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277587 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277677 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.277999 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278244 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278564 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278667 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278872 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.278979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279234 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279545 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279646 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.279956 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280176 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280485 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.280886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281107 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281207 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.281974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.282113 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.282392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.282505 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.282713 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.282805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283043 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283451 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283672 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283758 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.283981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.284079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.284307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.284406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.284613 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285515 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285661 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285742 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285906 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.285980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286367 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286453 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286678 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.286759 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287105 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.287986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.288233 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.288472 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.288560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.288838 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289037 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289137 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289523 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289743 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.289831 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290048 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290372 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290527 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290823 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.290981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291290 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291476 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.291894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.292195 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.292282 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.292501 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.292826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.292907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.293232 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.293475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.293828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.293828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.294076 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.294163 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.294432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.294784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.294883 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295219 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295579 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295742 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.295901 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.296060 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.296226 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.296620 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.296810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.296953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.297258 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.297368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.297595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.297928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298073 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298275 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298383 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298665 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.298963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.299187 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.299719 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.299825 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.299900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300216 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300443 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300766 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.300986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.301075 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.301294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.301385 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.301601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.301906 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.302177 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.302316 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.302566 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.302875 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303162 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303570 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303827 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.303935 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304146 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304312 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304656 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.304982 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.305091 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.305380 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.305479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.305693 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.305784 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306001 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306107 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306332 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306441 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306760 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.306980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.307075 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.307293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.307383 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.307597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.307696 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308018 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308109 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308333 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308429 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308648 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.308965 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309276 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309367 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309687 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.309910 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310237 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310383 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.310936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311043 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311269 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311586 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311707 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.311996 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.312226 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.312325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.312535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.312759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.312854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313169 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313415 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313524 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.313834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314151 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314394 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.314798 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315019 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315433 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315633 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.315936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316026 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316242 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316851 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.316941 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317156 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317256 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317562 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.317864 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318072 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318163 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318417 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318725 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.318991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319100 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319313 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319615 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319704 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.319942 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320231 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320564 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320655 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320892 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.320982 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321203 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321314 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321515 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.321924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322265 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322473 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.322869 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323189 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323515 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323719 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.323811 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324031 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324120 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324351 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324505 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.324977 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325081 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325288 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325404 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325598 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.325917 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326047 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326618 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326739 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.326928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327230 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327546 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327647 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.327920 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328169 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328474 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328565 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.328891 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329100 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329239 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329555 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329779 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.329872 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330199 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330446 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330548 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330758 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.330887 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331077 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331393 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331487 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.331826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332132 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332347 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.332778 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.333023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.333166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.333339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.333687 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.334020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.334118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.334468 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.334695 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.334812 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.335123 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.335294 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.335550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:11:38.335901 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.336572 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.337167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.338079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.338643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.339228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.339637 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.339974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.340305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.340641 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.340970 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.341293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.341644 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.342063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.342470 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.342797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.343159 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.343537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.344106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.344641 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.345252 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.346090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.346405 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.346772 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.347192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.347601 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.348144 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.348723 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.349293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.349741 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.350103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.350467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.350800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.351262 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.351592 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.351928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.352261 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.352827 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.353989 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.353989 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.353989 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.354278 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.354555 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.354899 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.357679 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.358082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.358596 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.358936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.359274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.359606 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.359940 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.360281 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.360612 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.361039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.361254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.361581 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.361971 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.362257 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.362734 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.362881 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.363200 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.363517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.363835 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.364154 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.364468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.364783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.365101 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.365421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.365737 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.366050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.366391 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.366710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.367027 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.367381 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.367734 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.368059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.368391 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.368713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.369044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.369359 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.369690 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.370024 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.370378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.370699 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.371043 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.371360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.371680 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.372019 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.372321 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.372636 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.373028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.373380 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.373713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.374027 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.374411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.374738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.375069 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.375391 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.375707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.376054 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.376354 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.376670 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.376990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.377305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.377620 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.377949 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.378294 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.378655 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.378972 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.379287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.379619 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.379961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.380325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.380722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.380999 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.381340 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.381676 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.381976 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.382573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 10:11:38.382573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 10:11:38.492433 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO dbcounter [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Registered counter for database nova_api Jul 05 10:11:38.514030 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.521377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.535197 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO dbcounter [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Registered counter for database nova_api Jul 05 10:11:38.555749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.563799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.578982 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.context [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=117864) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 10:11:38.582930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:11:38.584536 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:11:38.585351 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:11:38.587709 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:11:38.589725 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO dbcounter [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Registered counter for database nova_cell0 Jul 05 10:11:38.594473 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO dbcounter [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Registered counter for database nova_cell1 Jul 05 10:11:38.605554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.606899 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.613679 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.615790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.625933 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.context [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=117865) load_cells /opt/stack/nova/nova/context.py:464}} Jul 05 10:11:38.629938 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:11:38.631628 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:11:38.632446 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:11:38.634457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:11:38.636458 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO dbcounter [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Registered counter for database nova_cell0 Jul 05 10:11:38.640709 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO dbcounter [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Registered counter for database nova_cell1 Jul 05 10:11:38.647966 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.649715 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.654876 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.660627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.762269 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO dbcounter [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Registered counter for database nova_cell0 Jul 05 10:11:38.769595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_db.sqlalchemy.engines [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.774363 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writer thread running {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:38.802303 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO dbcounter [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Registered counter for database nova_cell0 Jul 05 10:11:38.809378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_db.sqlalchemy.engines [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 10:11:38.814123 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writer thread running {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 10:11:39.091421 dv-cinder-master-3-smb devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:11:39.098880 dv-cinder-master-3-smb devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:11:39.131678 dv-cinder-master-3-smb devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:11:39.139830 dv-cinder-master-3-smb devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:11:39.441799 dv-cinder-master-3-smb devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:11:39.447880 dv-cinder-master-3-smb devstack@n-api.service[117864]: WARNING keystonemiddleware.auth_token [None req-b1c9c7c9-4d84-41a8-a90d-bf382d029439 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:11:39.453272 dv-cinder-master-3-smb devstack@n-api.service[117864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b69ef1a9c0 pid: 117864 (default app) Jul 05 10:11:39.491136 dv-cinder-master-3-smb devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 05 10:11:39.497297 dv-cinder-master-3-smb devstack@n-api.service[117865]: WARNING keystonemiddleware.auth_token [None req-f50c79b8-06df-4194-a4cd-32cbcb36217a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 05 10:11:39.502801 dv-cinder-master-3-smb devstack@n-api.service[117865]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b69ef1a9c0 pid: 117865 (default app) Jul 05 10:12:20.661735 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:20.662749 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:20.663486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:20.664462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:22.547915 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9157c990-7500-4158-a722-de6ad1e5f934 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Action: 'create', calling method: .version_select at 0x7ffbf110d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-302860182"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:22.872810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:22.873887 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:22.874890 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:22.879459 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:23.244703 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-65455022-03d7-4371-a9a5-930131fad5b2 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf1164040>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:23.782766 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-65455022-03d7-4371-a9a5-930131fad5b2 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2ad3f5a3-10d5-4b5a-b5fc-89b571ec9e24" status: 200 len: 351 microversion: 2.1 time: 0.917072 Jul 05 10:12:23.783384 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:22 2022] GET /compute/v2.1/os-volumes/2ad3f5a3-10d5-4b5a-b5fc-89b571ec9e24 => generated 351 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:24.440121 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9157c990-7500-4158-a722-de6ad1e5f934 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.790195 Jul 05 10:12:24.442251 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Jul 5 10:12:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3794 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 10:12:24.464019 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b3e58837-ec55-4a9a-9c47-1ddd58da8305 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fcd430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:24.603157 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b3e58837-ec55-4a9a-9c47-1ddd58da8305 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 200 len: 344 microversion: 2.1 time: 0.150534 Jul 05 10:12:24.605993 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:24 2022] GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:25.657147 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-41c49167-3a8e-4463-a113-2643f6b90d45 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fd1430>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:25.660021 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-06eb379a-0bcb-455f-8320-422afb7fd65a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fcdb80>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:25.780941 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-41c49167-3a8e-4463-a113-2643f6b90d45 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 200 len: 345 microversion: 2.1 time: 0.164218 Jul 05 10:12:25.783056 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:25 2022] GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:25.805395 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-99ba51af-0481-4d51-afc1-2e37d384e103 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Action: 'create', calling method: .version_select at 0x7ffbf0fd19d0>, body: {"snapshot": {"volume_id": "9f9effee-da92-4a15-850f-76d0fb7b0317", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-832696066"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:26.012308 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-06eb379a-0bcb-455f-8320-422afb7fd65a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/68cb3893-6fa2-4f86-b082-d3148d73de73" status: 200 len: 351 microversion: 2.1 time: 0.355381 Jul 05 10:12:26.013151 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:25 2022] GET /compute/v2.1/os-volumes/68cb3893-6fa2-4f86-b082-d3148d73de73 => generated 351 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:26.295778 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-99ba51af-0481-4d51-afc1-2e37d384e103 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.504310 Jul 05 10:12:26.296362 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 3/6] 10.222.0.16 () {60 vars in 1161 bytes} [Tue Jul 5 10:12:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:26.308722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-00e09bf5-f204-412d-aaa5-269a5e42205c tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fdd310>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:26.584809 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-00e09bf5-f204-412d-aaa5-269a5e42205c tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b" status: 200 len: 286 microversion: 2.1 time: 0.280695 Jul 05 10:12:26.585715 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 5 10:12:26 2022] GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b => generated 286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:26.596156 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ca56d6f4-de79-4396-8c54-8d8034c878f0 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fec040>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:26.744840 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ca56d6f4-de79-4396-8c54-8d8034c878f0 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.152822 Jul 05 10:12:26.746527 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jul 5 10:12:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:26.757507 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-30a489db-1139-4926-8c3e-034f4323e481 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fcdca0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:26.949674 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-30a489db-1139-4926-8c3e-034f4323e481 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b" status: 200 len: 287 microversion: 2.1 time: 0.196485 Jul 05 10:12:26.950887 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 5/9] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 5 10:12:26 2022] GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b => generated 287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:12:26.966872 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c616ccec-a0ee-4a6f-b02b-deb3e24a9847 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fecd30>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:27.079733 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c616ccec-a0ee-4a6f-b02b-deb3e24a9847 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b" status: 202 len: 0 microversion: 2.1 time: 0.121291 Jul 05 10:12:27.080346 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 5/10] 10.222.0.16 () {58 vars in 1253 bytes} [Tue Jul 5 10:12:26 2022] DELETE /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:12:27.090632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b38408ba-427d-4c90-a25a-7f3c4f02495c tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fcd550>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:27.131501 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b38408ba-427d-4c90-a25a-7f3c4f02495c tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b" status: 200 len: 286 microversion: 2.1 time: 0.045605 Jul 05 10:12:27.135902 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 5 10:12:27 2022] GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b => generated 286 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:27.989705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b300bde7-a170-4547-b498-24e5df3a3b87 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fecaf0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.144184 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc728f0b-15e7-4540-bb33-d4b903186d47 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fdd430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.149547 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b300bde7-a170-4547-b498-24e5df3a3b87 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/af18dbe5-f719-4e80-929a-15afb3fcde64" status: 200 len: 350 microversion: 2.1 time: 0.164200 Jul 05 10:12:28.150580 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:27 2022] GET /compute/v2.1/os-volumes/af18dbe5-f719-4e80-929a-15afb3fcde64 => generated 350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:28.164405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d862b2e6-f27a-4878-a349-ace8dfb67ebe tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fec550>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.248666 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-cc728f0b-15e7-4540-bb33-d4b903186d47 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] HTTP exception thrown: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc728f0b-15e7-4540-bb33-d4b903186d47 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Request method failure captured: Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b HTTP/1.1 Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6EjSBEafBLhAJCHjFJ3EZiQ1QYDwTogy1Hy6Q0__R3e3y00f5TMif_dvS9nb_gQE95xeA3t9a-hK56cm96AX4uVc6DmxTWnRnrdreZ2HIu-k1IXMIW94AeEBTJ0AhhNIdt1bmPZW4DfpuWPZ8UuSptgoFmwK_lnfANEknb8P9mXDQ Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:12:28.252977 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e545a9dca63a4f0aa719494f273262af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 8fc0b54d732e43f38fead2ce492d1641 Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '1e702a55-d435-4cef-8e03-ee8bc2ab837b'} Jul 05 10:12:28.254331 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. (HTTP 404) (Request-ID: req-bf9f8c8f-d92e-4381-b7d4-f1c7a5b025e1) Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.255141 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:28.256041 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 05 10:12:28.257042 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cc728f0b-15e7-4540-bb33-d4b903186d47 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Returning 404 to user: Snapshot 1e702a55-d435-4cef-8e03-ee8bc2ab837b could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:12:28.257970 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cc728f0b-15e7-4540-bb33-d4b903186d47 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b" status: 404 len: 111 microversion: 2.1 time: 0.116150 Jul 05 10:12:28.260818 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-snapshots/1e702a55-d435-4cef-8e03-ee8bc2ab837b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:12:28.269320 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8efaf7e2-0eee-4e17-8ad6-5fb9d9209a91 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fddca0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.481637 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8efaf7e2-0eee-4e17-8ad6-5fb9d9209a91 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 202 len: 0 microversion: 2.1 time: 0.219661 Jul 05 10:12:28.482666 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 8/14] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:12:28 2022] DELETE /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:12:28.490022 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d862b2e6-f27a-4878-a349-ace8dfb67ebe tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.331467 Jul 05 10:12:28.494141 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:28.505292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f42bb3e5-9ae5-43b8-9fde-701395fe3622 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fb9430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.515864 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-460ff954-7a45-43fe-905c-a905070d7dd2 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fd1280>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.624649 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f42bb3e5-9ae5-43b8-9fde-701395fe3622 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 200 len: 344 microversion: 2.1 time: 0.137336 Jul 05 10:12:28.625719 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:12:28.766479 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-460ff954-7a45-43fe-905c-a905070d7dd2 tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.260653 Jul 05 10:12:28.775564 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1148 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:12:28.782283 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e669b9d0-b9e8-46f2-a71e-a5a14abd9d1a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fddca0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:28.983954 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e669b9d0-b9e8-46f2-a71e-a5a14abd9d1a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.206888 Jul 05 10:12:28.984563 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1133 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:28.997115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4fd55b86-3547-4778-8c5c-e932468e04ad tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fd19d0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.236966 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4fd55b86-3547-4778-8c5c-e932468e04ad tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.244567 Jul 05 10:12:29.244117 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 9/19] 10.222.0.16 () {58 vars in 1166 bytes} [Tue Jul 5 10:12:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:29.250958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ff406b91-056c-4f1d-8f75-d8c93672fe2a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fb94c0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.539624 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ff406b91-056c-4f1d-8f75-d8c93672fe2a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.293970 Jul 05 10:12:29.540472 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 11/20] 10.222.0.16 () {58 vars in 1169 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:29.552353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9218c69d-9b29-402a-85c6-0c7bee695e7d tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fec040>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.637998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16174d04-45c1-4c3a-b73e-c5dd9f0b125f tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fdd5e0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.733037 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9218c69d-9b29-402a-85c6-0c7bee695e7d tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184489 Jul 05 10:12:29.734382 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 10/21] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:29.745920 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1c21d7b5-9952-4d25-93e0-ce030be61f0f tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fecdc0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.790135 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-16174d04-45c1-4c3a-b73e-c5dd9f0b125f tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] HTTP exception thrown: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16174d04-45c1-4c3a-b73e-c5dd9f0b125f tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Request method failure captured: Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 HTTP/1.1 Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6EjSBEafBLhAJCHjFJ3EZiQ1QYDwTogy1Hy6Q0__R3e3y00f5TMif_dvS9nb_gQE95xeA3t9a-hK56cm96AX4uVc6DmxTWnRnrdreZ2HIu-k1IXMIW94AeEBTJ0AhhNIdt1bmPZW4DfpuWPZ8UuSptgoFmwK_lnfANEknb8P9mXDQ Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:12:29.793137 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e545a9dca63a4f0aa719494f273262af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 8fc0b54d732e43f38fead2ce492d1641 Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '9f9effee-da92-4a15-850f-76d0fb7b0317'} Jul 05 10:12:29.794449 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. (HTTP 404) (Request-ID: req-96b1415d-bb96-4717-9c07-9bfc6511e81d) Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.795119 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:29.796158 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 10:12:29.797205 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.798358 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.800775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16174d04-45c1-4c3a-b73e-c5dd9f0b125f tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Returning 404 to user: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:12:29.801847 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16174d04-45c1-4c3a-b73e-c5dd9f0b125f tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 404 len: 109 microversion: 2.1 time: 0.168059 Jul 05 10:12:29.814341 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 12/22] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:12:29.824710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1640a4ec-0f71-48e7-a737-6304136c5592 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf0fb9b80>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.940717 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-1640a4ec-0f71-48e7-a737-6304136c5592 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] HTTP exception thrown: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1640a4ec-0f71-48e7-a737-6304136c5592 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Request method failure captured: Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 HTTP/1.1 Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6EjSBEafBLhAJCHjFJ3EZiQ1QYDwTogy1Hy6Q0__R3e3y00f5TMif_dvS9nb_gQE95xeA3t9a-hK56cm96AX4uVc6DmxTWnRnrdreZ2HIu-k1IXMIW94AeEBTJ0AhhNIdt1bmPZW4DfpuWPZ8UuSptgoFmwK_lnfANEknb8P9mXDQ Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:12:29.943244 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e545a9dca63a4f0aa719494f273262af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 8fc0b54d732e43f38fead2ce492d1641 Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '9f9effee-da92-4a15-850f-76d0fb7b0317'} Jul 05 10:12:29.944491 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. (HTTP 404) (Request-ID: req-fe1c731a-db2f-40cb-afc3-972a73b22138) Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.945272 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:12:29.946432 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 10:12:29.947603 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:29.948807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:29.950132 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1640a4ec-0f71-48e7-a737-6304136c5592 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Returning 404 to user: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:12:29.951900 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1640a4ec-0f71-48e7-a737-6304136c5592 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 404 len: 109 microversion: 2.1 time: 0.135432 Jul 05 10:12:29.952739 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 13/23] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:12:29 2022] DELETE /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:12:29.955717 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1c21d7b5-9952-4d25-93e0-ce030be61f0f tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213767 Jul 05 10:12:29.956160 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1187 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:29.972846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-43fc8079-aab9-4422-b7d7-2c7e7165080a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] Calling method '.version_select at 0x7ffbf0fecaf0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:29.973120 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6cf24b96-8548-4d7b-a75b-600b1d4749d3 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Calling method '.version_select at 0x7ffbf19bba60>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:30.118368 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-43fc8079-aab9-4422-b7d7-2c7e7165080a tempest-VolumesTestJSON-1732924737 tempest-VolumesTestJSON-1732924737-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.153503 Jul 05 10:12:30.120012 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1154 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:30.194485 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-6cf24b96-8548-4d7b-a75b-600b1d4749d3 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] HTTP exception thrown: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6cf24b96-8548-4d7b-a75b-600b1d4749d3 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Request method failure captured: Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 HTTP/1.1 Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6EjSBEafBLhAJCHjFJ3EZiQ1QYDwTogy1Hy6Q0__R3e3y00f5TMif_dvS9nb_gQE95xeA3t9a-hK56cm96AX4uVc6DmxTWnRnrdreZ2HIu-k1IXMIW94AeEBTJ0AhhNIdt1bmPZW4DfpuWPZ8UuSptgoFmwK_lnfANEknb8P9mXDQ Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:12:30.198792 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e545a9dca63a4f0aa719494f273262af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e545a9dca63a4f0aa719494f273262af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: e545a9dca63a4f0aa719494f273262af Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1530843135 Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 8fc0b54d732e43f38fead2ce492d1641 Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1530843135-project Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '9f9effee-da92-4a15-850f-76d0fb7b0317'} Jul 05 10:12:30.200090 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. (HTTP 404) (Request-ID: req-a80cb0f9-9a17-4476-8c03-706f06eb0c1e) Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:30.200968 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:12:30.202548 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 10:12:30.203419 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6cf24b96-8548-4d7b-a75b-600b1d4749d3 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] Returning 404 to user: Volume 9f9effee-da92-4a15-850f-76d0fb7b0317 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6cf24b96-8548-4d7b-a75b-600b1d4749d3 tempest-VolumesSnapshotsTestJSON-1530843135 tempest-VolumesSnapshotsTestJSON-1530843135-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317" status: 404 len: 109 microversion: 2.1 time: 0.243187 Jul 05 10:12:30.205898 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:12:29 2022] GET /compute/v2.1/os-volumes/9f9effee-da92-4a15-850f-76d0fb7b0317 => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:12:31.173524 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1875303142", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:31.399633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] validate_networks() for [('555e67c4-3856-41b0-a7ee-e5d3fa1cf9af', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:12:34.375947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:12:34.375947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:12:34.375947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:12:34.375947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:12:34.376674 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:12:34.428543 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:34.428999 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:34.454441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:34.454910 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:34.522454 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:12:34.531449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for user 3c6e5faddabd4208b6e476be4b59e834 and project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:12:34.548334 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:12:34.552126 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:12:34.680420 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6f72ed62-3a94-49f7-936c-6137a931f899 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.159594 Jul 05 10:12:34.681351 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 13/27] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:12:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 4161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:12:34.692832 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-08d900f1-e0b5-47c6-abaf-17c4a507e7f7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:34.693580 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-08d900f1-e0b5-47c6-abaf-17c4a507e7f7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:35.023943 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-08d900f1-e0b5-47c6-abaf-17c4a507e7f7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:35.064834 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-08d900f1-e0b5-47c6-abaf-17c4a507e7f7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1222 microversion: 2.1 time: 0.377011 Jul 05 10:12:35.069033 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:34 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1222 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:35.892179 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-223856686", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:36.032128 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] validate_networks() for [('555e67c4-3856-41b0-a7ee-e5d3fa1cf9af', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:12:37.905804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:12:37.906388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:12:37.907055 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:12:37.907472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:12:37.907884 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:12:37.908976 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2019240501", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "97a3bac3-53a8-430c-bed3-2f64f0f0814b"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:37.921595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:37.924268 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:37.925116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:37.926755 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:37.994728 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:12:38.008069 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for user 3c6e5faddabd4208b6e476be4b59e834 and project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:12:38.047748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:12:38.049874 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:12:38.153169 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b1b5b9ce-6f3b-447b-96f5-9a1c38fbf134 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.268042 Jul 05 10:12:38.155684 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 14/29] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:12:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:12:38.167369 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2104bbf2-dc21-430c-8287-9771e7cdf516 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:38.168023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2104bbf2-dc21-430c-8287-9771e7cdf516 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:38.251279 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] validate_networks() for [('97a3bac3-53a8-430c-bed3-2f64f0f0814b', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:12:38.483475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2104bbf2-dc21-430c-8287-9771e7cdf516 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:38.520306 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2104bbf2-dc21-430c-8287-9771e7cdf516 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1221 microversion: 2.1 time: 0.360219 Jul 05 10:12:38.529886 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:38 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:12:39.489184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7f36a240-a9f2-43e6-aa6c-6259e2be6661 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: .version_select at 0x7ffbf0680c10>, body: {"keypair": {"name": "tempest-keypair-1639041059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJEWeuW5uCa7xxIh0e2OQeGVggHeMeX/JlJGcLf0qma57cENp4xIBX7ydEJ59Hn1PUKGhxwlyeI+adzkokS8gUpUxG1qfh4Ww8+fkcWd7TpYzdewMhFwGGhXX06U7dg0Xg=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:39.581301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-7f36a240-a9f2-43e6-aa6c-6259e2be6661 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for project d343798527cf445295916cc8e8134bf3. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:12:39.604931 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-7f36a240-a9f2-43e6-aa6c-6259e2be6661 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for user 51e20b9a489342d2b8f0f85542ab370c and project d343798527cf445295916cc8e8134bf3. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:12:39.776950 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7f36a240-a9f2-43e6-aa6c-6259e2be6661 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.244233 Jul 05 10:12:39.786706 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 16/31] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jul 5 10:12:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 10:12:39.817945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8e9e0539-c651-468e-adb3-556b8966fc47 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:39.818618 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8e9e0539-c651-468e-adb3-556b8966fc47 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:40.089500 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8e9e0539-c651-468e-adb3-556b8966fc47 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:40.098635 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8e9e0539-c651-468e-adb3-556b8966fc47 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1221 microversion: 2.1 time: 0.310559 Jul 05 10:12:40.108723 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 17/32] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:39 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:41.115639 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:41.116308 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:41.129238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:41.129675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:41.149607 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:41.150057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:42.040488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:42.059619 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:12:42.060253 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:12:42.060547 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:12:42.060948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:12:42.061416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:12:42.107244 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bb93e4a7-8109-4199-a728-deed9b2f7a68 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1273 microversion: 2.1 time: 0.995085 Jul 05 10:12:42.107900 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 18/33] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:41 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1273 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:12:42.149974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:42.152752 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:42.153807 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:42.154298 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:42.290772 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Getting quotas for project cf8cdaba37244ff9bcf6df35373f1467. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:12:42.318669 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Getting quotas for user 7d4bb910a5bc4c7ea2667dc65066b2bd and project cf8cdaba37244ff9bcf6df35373f1467. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:12:42.363799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:12:42.377010 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:12:42.618777 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0dde46ca-ca06-44dd-aa30-bd719cb490ae tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.483565 Jul 05 10:12:42.626337 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 16/34] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 5498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:12:42.637536 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-435360c2-becc-491b-bf15-b944401c642c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:42.638299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-435360c2-becc-491b-bf15-b944401c642c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:42.765826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-435360c2-becc-491b-bf15-b944401c642c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:42.774207 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-435360c2-becc-491b-bf15-b944401c642c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1215 microversion: 2.1 time: 0.140923 Jul 05 10:12:42.793483 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 19/35] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:42 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:43.126250 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:43.126957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:43.141530 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:43.146362 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:43.147199 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:43.147653 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:43.800717 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6bfd3ca6-4c8e-4687-86a0-492c3d3f815d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:43.801432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6bfd3ca6-4c8e-4687-86a0-492c3d3f815d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:44.117501 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6bfd3ca6-4c8e-4687-86a0-492c3d3f815d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:44.133561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:44.153838 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6bfd3ca6-4c8e-4687-86a0-492c3d3f815d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1215 microversion: 2.1 time: 0.357095 Jul 05 10:12:44.171550 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 20/36] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:43 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1215 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:12:44.186534 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2948376e-b580-42c0-9f5b-3f42e1112d6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1279 microversion: 2.1 time: 1.064597 Jul 05 10:12:44.193715 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:43 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1279 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:45.179814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:45.180657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:45.191493 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:45.198494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:45.209086 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:45.211555 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:45.227292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:45.228195 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:45.241530 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:45.250261 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:45.254700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:45.265132 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:45.443012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:45.458533 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8379f374-9fba-4f74-a02c-eadf62742cb1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1267 microversion: 2.1 time: 0.284560 Jul 05 10:12:45.459580 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 21/38] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:45 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:45.481520 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:45.491209 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-03f3c4e3-0d13-4179-b333-12445d56e4c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1279 microversion: 2.1 time: 0.267009 Jul 05 10:12:45.512133 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 18/39] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:45 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:46.477077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:46.483482 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:46.496053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:46.501264 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:46.502269 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:46.510974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:46.511669 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:46.519854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:46.527786 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:46.528315 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:46.529085 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:46.529516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:47.186786 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:47.188746 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:47.199382 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-41b4565d-b289-4b5f-be7e-84d6a187c4e5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1273 microversion: 2.1 time: 0.727048 Jul 05 10:12:47.201741 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-526a206b-5b2b-4924-9941-cc205b627223 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1279 microversion: 2.1 time: 0.693635 Jul 05 10:12:47.202169 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:46 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1279 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:47.210834 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:46 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1273 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:48.221551 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:48.222463 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:48.229916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:48.231322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:48.240201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:48.241703 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:48.241874 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:48.246897 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:48.247314 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:48.247958 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:48.248964 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:48.249617 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:48.253426 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:48.467441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:48.500747 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7ffcfabe-d5ca-4fb0-9c27-b5849f51f6f9 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1273 microversion: 2.1 time: 0.271879 Jul 05 10:12:48.503210 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 23/42] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:48 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:48.823965 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:48.858861 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-945d85e3-4566-4d17-892e-02b2c5fb27df tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1279 microversion: 2.1 time: 0.628438 Jul 05 10:12:48.858861 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 20/43] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:48 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1279 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:49.520549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:49.521798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:49.540584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:49.541231 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:49.542211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:49.542841 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:49.875181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:49.875775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:49.907385 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:49.909477 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:49.911138 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:49.911634 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:50.742383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:50.765464 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-24b9ff9d-16d7-4f12-9407-d2063c4e1e9d tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 1.235741 Jul 05 10:12:50.769968 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 24/44] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:49 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:50.801557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1156689358", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eec36f3b-26bf-47cd-bc08-cd0f11c95ea2"}], "security_groups": [{"name": "tempest-securitygroup--1041296532"}], "key_name": "tempest-keypair-1639041059", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:51.227284 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:51.239104 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-40b9036f-808d-4ae1-b7e2-aceb6eac8b57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 1.364925 Jul 05 10:12:51.241674 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 21/45] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:49 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:51.692277 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] validate_networks() for [('eec36f3b-26bf-47cd-bc08-cd0f11c95ea2', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:12:51.783325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:51.783937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:51.800089 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:51.800566 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:51.804707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:51.808174 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:52.225609 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:52.351471 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=8 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:53.417856 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:53.432787 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cf6c4cae-0598-422e-aad9-9d1af81377dd tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 1.653306 Jul 05 10:12:53.445422 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 22/46] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:51 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:53.457180 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:53.460373 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:53.484838 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:53.485615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:53.487277 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:53.490025 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:53.929633 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:53.943028 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-70723873-5116-4ef7-bc40-d2f27029465f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.495898 Jul 05 10:12:53.944280 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 23/47] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:53 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:54.122444 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=24 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:12:54.266438 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-8b9a2490-2809-44fc-9e1d-940f441cd16d req-29a08829-3aa1-452c-b7eb-282b9e4f31aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d51ee6e-4926-463c-82fa-66b06c93c8da", "tag": "b589a7dd-d1a3-4310-859e-041c8d2387f9"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:54.302954 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8b9a2490-2809-44fc-9e1d-940f441cd16d req-29a08829-3aa1-452c-b7eb-282b9e4f31aa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:54.305716 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8b9a2490-2809-44fc-9e1d-940f441cd16d req-29a08829-3aa1-452c-b7eb-282b9e4f31aa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:54.359281 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-8b9a2490-2809-44fc-9e1d-940f441cd16d req-29a08829-3aa1-452c-b7eb-282b9e4f31aa service nova] Creating event network-changed:b589a7dd-d1a3-4310-859e-041c8d2387f9 for instance 6d51ee6e-4926-463c-82fa-66b06c93c8da on hv-cinder-maste Jul 05 10:12:54.359826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8b9a2490-2809-44fc-9e1d-940f441cd16d req-29a08829-3aa1-452c-b7eb-282b9e4f31aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=117865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 10:12:54.361091 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:54.361563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:54.370419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:54.370937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:54.398658 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.compute.rpcapi [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 10:12:54.399867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] Releasing lock "compute-rpcapi-router" {{(pid=117865) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 10:12:54.446403 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-94faf6fc-81e7-467e-b045-a9506bf30216 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.496528 Jul 05 10:12:54.447805 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 24/48] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:54.453813 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:54.454888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:54.463040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:54.463838 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:54.465250 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:54.465858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:55.787271 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:12:55.788327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:12:55.789418 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:12:55.790547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:12:55.791348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:12:55.813113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:55.814608 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:55.818097 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:55.819107 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:55.872870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for project d343798527cf445295916cc8e8134bf3. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:12:55.881057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for user 51e20b9a489342d2b8f0f85542ab370c and project d343798527cf445295916cc8e8134bf3. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:12:55.909135 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:12:55.920025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:12:56.065424 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1361a0a1-6f1b-4e16-a021-5668239db80b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.294147 Jul 05 10:12:56.066877 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 25/49] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jul 5 10:12:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 5296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 10:12:56.075204 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:56.077162 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:56.086579 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:56.087403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:56.088415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:56.089496 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:56.189349 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:56.218623 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7396c49d-3078-4026-b4e0-1a1a8ea3a451 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 1.760895 Jul 05 10:12:56.219591 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 25/50] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:54 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:56.251958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:56.253775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:56.660936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:56.675392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:56.686549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:56.688001 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3b7cd5d7-2cfb-4c51-9196-05d8b8539072 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1282 microversion: 2.20 time: 0.452955 Jul 05 10:12:56.699868 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:12:56 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1282 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:12:56.708561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-899a4003-813d-4c6a-a42b-73ec15081f58 req-8552f139-e815-4cfa-8a91-251dfddb5f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea4c03a-7d8a-4595-a5a7-e70971848db7", "tag": "25d94d3c-deb0-4986-b0a3-a69d62aa8fce"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:56.721658 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-899a4003-813d-4c6a-a42b-73ec15081f58 req-8552f139-e815-4cfa-8a91-251dfddb5f3a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:56.722337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-899a4003-813d-4c6a-a42b-73ec15081f58 req-8552f139-e815-4cfa-8a91-251dfddb5f3a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:56.737012 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-899a4003-813d-4c6a-a42b-73ec15081f58 req-8552f139-e815-4cfa-8a91-251dfddb5f3a service nova] Creating event network-changed:25d94d3c-deb0-4986-b0a3-a69d62aa8fce for instance eea4c03a-7d8a-4595-a5a7-e70971848db7 on hv-cinder-maste Jul 05 10:12:56.746400 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-899a4003-813d-4c6a-a42b-73ec15081f58 req-8552f139-e815-4cfa-8a91-251dfddb5f3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044413 Jul 05 10:12:56.747151 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 27/52] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:56.817481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:56.847714 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a7c7c2c9-d7b2-4cc2-980b-0b3f0b2915a6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.778461 Jul 05 10:12:56.851155 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 26/53] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:56 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:57.007152 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-776cd12a-3da9-4bbd-94ad-22717545db62 req-5d38b0b3-2a24-40c6-881b-afaf1ede0aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92a9a19-5c0e-4a64-8248-0900ee1578fd", "tag": "3a3fce1d-656c-4d35-b526-cc2cacb6c758"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:12:57.023134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-776cd12a-3da9-4bbd-94ad-22717545db62 req-5d38b0b3-2a24-40c6-881b-afaf1ede0aa8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.023594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-776cd12a-3da9-4bbd-94ad-22717545db62 req-5d38b0b3-2a24-40c6-881b-afaf1ede0aa8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.037740 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-776cd12a-3da9-4bbd-94ad-22717545db62 req-5d38b0b3-2a24-40c6-881b-afaf1ede0aa8 service nova] Creating event network-changed:3a3fce1d-656c-4d35-b526-cc2cacb6c758 for instance f92a9a19-5c0e-4a64-8248-0900ee1578fd on hv-cinder-maste Jul 05 10:12:57.053876 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-776cd12a-3da9-4bbd-94ad-22717545db62 req-5d38b0b3-2a24-40c6-881b-afaf1ede0aa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304720 Jul 05 10:12:57.057146 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:12:57.238414 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:57.239283 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:57.251487 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.251936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.252727 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.253157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.423697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:57.434485 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-826f58a5-28f8-46bb-b80e-f842ec084be1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.200847 Jul 05 10:12:57.435535 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 27/55] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:57 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:57.708560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:57.710977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:57.719924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.720589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.723070 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.723896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.867971 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:57.869124 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:57.880436 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.881666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.882762 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:57.883243 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:57.971382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:57.990822 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:57.993543 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:58.001520 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b2872f6e-df54-48ae-95de-31dd54dcb711 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1286 microversion: 2.20 time: 0.294544 Jul 05 10:12:58.003610 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 29/56] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:12:57 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1286 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:12:58.369241 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:58.378069 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-92796f9b-092f-457e-bf4e-d578428d36aa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.515009 Jul 05 10:12:58.382833 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 28/57] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:57 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:58.452306 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:58.453148 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:58.460736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:58.461505 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:58.462928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:58.463791 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:58.742011 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:58.753874 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e6765c87-d630-44b6-b50e-71472093e6b1 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.305820 Jul 05 10:12:58.763629 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 30/58] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:58 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:59.021096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:59.022948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:59.029563 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.030347 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.031365 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.032039 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.104898 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:59.115410 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:59.117636 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:59.118764 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-69c9565c-b254-45b9-bf0e-ed67fd463697 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1334 microversion: 2.20 time: 0.101938 Jul 05 10:12:59.119704 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 29/59] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:12:59 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:12:59.395280 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:59.395884 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:59.402498 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.403236 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.404417 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.405057 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.565049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:59.575317 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-054ad875-a7e1-4019-9c1e-ad8de6a5bf60 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.183790 Jul 05 10:12:59.576155 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 31/60] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:59 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:12:59.770635 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:12:59.771622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:12:59.782454 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.782999 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.783930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:12:59.784404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:12:59.980787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:12:59.991958 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8a1f22e9-0ab1-439c-9bed-dc6dd5551fb7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.224967 Jul 05 10:13:00.001438 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 30/61] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:12:59 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:00.137842 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:00.138554 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:00.146825 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:00.147361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:00.148229 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:00.148812 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:00.222982 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:00.231676 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:00.233246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:00.234380 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-06d85823-49db-4a87-908c-722823b65f8f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1334 microversion: 2.20 time: 0.100698 Jul 05 10:13:00.235147 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:00 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:00.594368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:00.594988 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:00.598624 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:00.605932 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:00.608665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:00.611383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:00.612312 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:01.008928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:01.009548 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:01.026462 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:01.027085 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:01.028126 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:01.028722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:01.255799 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:01.258072 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=71 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:01.278084 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b1c3da0b-b477-4b73-a657-e3cf922e3551 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.688341 Jul 05 10:13:01.278945 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:00 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:01.295836 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:01.297245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:01.306561 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:01.308789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:01.309843 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:01.310503 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:01.402369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:01.416173 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3727c631-ed2d-4a7b-a6ac-b5f8304a9bdb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.405275 Jul 05 10:13:01.426277 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 33/64] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:01 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:01.462882 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:01.472909 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:01.479968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:01.481987 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-54680438-d23e-4c4a-a586-addce67126ff tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1342 microversion: 2.20 time: 0.194168 Jul 05 10:13:01.483255 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:01 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:02.295740 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:02.296419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:02.302369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.303064 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.304055 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.304669 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.437578 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:02.438200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:02.445909 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.447325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.448871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.449232 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.463140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:02.475327 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-26ccfd6d-3db9-4e02-a02a-d017a2cae623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.183391 Jul 05 10:13:02.485249 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 34/66] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:02 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:02.501158 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:02.501761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:02.510338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.510792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.511635 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:02.512137 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:02.637030 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:02.641195 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:02.647667 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:02.649200 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:02.650728 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-26c64e4e-3e41-42b9-bd09-b834717c3d74 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1342 microversion: 2.20 time: 0.153669 Jul 05 10:13:02.651837 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 35/67] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:02 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:13:02.666833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:02.674625 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58850de6-4681-49b5-85eb-d73f2b45c45e tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.243701 Jul 05 10:13:02.675788 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 33/68] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:02 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:03.492580 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:03.493196 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:03.507194 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.507568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.508381 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.511209 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.670502 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:03.671337 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:03.687566 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.688515 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.691379 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.694251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.851175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:03.861294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:03.876973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:03.880514 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-578c9ebd-e2b6-42c1-8fdb-bb02ee2dcf62 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1340 microversion: 2.20 time: 0.215379 Jul 05 10:13:03.886622 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 34/69] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:03 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:03.899405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:03.903614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:03.918783 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.919980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.921223 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:03.924576 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:03.937485 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:03.950945 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5accd644-3433-478e-969c-bd39676304f8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.461312 Jul 05 10:13:03.953995 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:03 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:04.241053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:04.249148 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-632b4467-3868-435f-b47c-410e77c7b9e0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.361163 Jul 05 10:13:04.254420 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 35/71] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:03 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:04.899728 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:04.900341 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:04.905773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:04.906701 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:04.908729 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:04.909317 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:04.910774 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:04.911354 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:04.971765 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:04.984092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:04.996733 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:04.997705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:04.999116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:04.999963 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:05.012494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:05.030091 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:05.032401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:05.034060 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0dec3031-4235-44e6-9fb2-0fdbcd70212d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1340 microversion: 2.20 time: 0.138220 Jul 05 10:13:05.035242 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:04 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1340 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:13:05.187077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:05.198872 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-34d01ba1-ed2b-4bec-a726-7e89beb54e1f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.232148 Jul 05 10:13:05.199601 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 36/73] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:04 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:05.281632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:05.282854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:05.302299 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:05.303177 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:05.307081 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:05.310142 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:05.812202 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:05.822489 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0ba92da0-a7a3-40f9-822c-14e6531e5db0 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.546304 Jul 05 10:13:05.825931 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:05 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:06.053057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:06.054546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:06.065649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:06.068255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:06.072603 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.074416 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.075354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.076545 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.218025 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:06.218449 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:06.229510 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.229933 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.242257 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.242894 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.288119 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:06.296791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:06.299172 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:06.300526 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2277eefe-4b63-42b6-a8df-78ebc9e7f72e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1340 microversion: 2.20 time: 0.251918 Jul 05 10:13:06.301294 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 37/75] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:06 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1340 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:06.382451 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-52389ef2-9add-48c9-83cc-262b919a8ad7 req-f20be66e-ae62-4e32-ac2d-249bc3aee7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d51ee6e-4926-463c-82fa-66b06c93c8da", "name": "network-vif-plugged", "status": "completed", "tag": "b589a7dd-d1a3-4310-859e-041c8d2387f9"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:06.394937 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-52389ef2-9add-48c9-83cc-262b919a8ad7 req-f20be66e-ae62-4e32-ac2d-249bc3aee7df service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.395753 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-52389ef2-9add-48c9-83cc-262b919a8ad7 req-f20be66e-ae62-4e32-ac2d-249bc3aee7df service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.418131 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-52389ef2-9add-48c9-83cc-262b919a8ad7 req-f20be66e-ae62-4e32-ac2d-249bc3aee7df service nova] Creating event network-vif-plugged:b589a7dd-d1a3-4310-859e-041c8d2387f9 for instance 6d51ee6e-4926-463c-82fa-66b06c93c8da on hv-cinder-maste Jul 05 10:13:06.419115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-52389ef2-9add-48c9-83cc-262b919a8ad7 req-f20be66e-ae62-4e32-ac2d-249bc3aee7df service nova] Acquired lock "compute-rpcapi-router" {{(pid=117864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 05 10:13:06.420480 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.421181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.422161 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.422824 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.433196 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.compute.rpcapi [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 05 10:13:06.434896 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] Releasing lock "compute-rpcapi-router" {{(pid=117864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 05 10:13:06.463941 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-71bac822-c7f8-4a14-b619-0f4604c03687 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143750 Jul 05 10:13:06.465816 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 38/76] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:13:06.666796 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:06.845085 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:06.847147 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:06.853216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:06.866582 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.867256 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.870583 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16f99b52-8dbe-4c9c-8936-03f8b1487aeb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.652582 Jul 05 10:13:06.873601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:06.875415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:06.881159 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 39/77] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:06 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:07.183747 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1862101239", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "07358646-d470-4f4e-a1d6-eb2265f98d99"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:07.247028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] validate_networks() for [('07358646-d470-4f4e-a1d6-eb2265f98d99', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:13:07.439188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:07.462746 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-014e0c1c-f908-478a-95cd-c06efe2056b8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.618772 Jul 05 10:13:07.464432 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 39/78] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:06 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:07.470730 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:07.471794 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:07.491306 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:07.491867 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:07.494000 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:07.494584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.076883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:08.091314 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:08.093428 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:08.099394 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-140c9f4e-5f8a-4f2c-8075-979d87322cc5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.633532 Jul 05 10:13:08.111510 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 40/79] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:07 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:08.120676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:08.121706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:08.129407 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.131388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.132669 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.133323 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.550784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:08.566488 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-de5f2267-df58-4257-98ee-4d3aea555ef1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.459509 Jul 05 10:13:08.575271 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:13:08.579467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:13:08.580512 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:13:08.581112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:13:08.581398 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:08 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:08.582036 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:13:08.602587 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.616112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.617712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.617877 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:08.618977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.620544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:08.645007 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Getting quotas for project 4a7e4c4e4d154bd9a7197190a9d8b27f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:13:08.648580 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.649475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.651013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.652350 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Getting quotas for user c323490c11b9461898687e729cd357f2 and project 4a7e4c4e4d154bd9a7197190a9d8b27f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:13:08.668283 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.677425 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:13:08.681278 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:13:08.765331 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-47b15b72-0841-4880-8be6-62b3ac4eddd7 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661082 Jul 05 10:13:08.775080 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 40/81] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 05 10:13:08.784284 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-648082f3-1cda-4a0a-8711-174534caf79f req-696df802-08d6-4e50-a218-f2c3d308f331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea4c03a-7d8a-4595-a5a7-e70971848db7", "name": "network-vif-plugged", "status": "completed", "tag": "25d94d3c-deb0-4986-b0a3-a69d62aa8fce"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:08.798743 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-648082f3-1cda-4a0a-8711-174534caf79f req-696df802-08d6-4e50-a218-f2c3d308f331 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:08.799411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-648082f3-1cda-4a0a-8711-174534caf79f req-696df802-08d6-4e50-a218-f2c3d308f331 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:08.823839 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-648082f3-1cda-4a0a-8711-174534caf79f req-696df802-08d6-4e50-a218-f2c3d308f331 service nova] Creating event network-vif-plugged:25d94d3c-deb0-4986-b0a3-a69d62aa8fce for instance eea4c03a-7d8a-4595-a5a7-e70971848db7 on hv-cinder-maste Jul 05 10:13:08.833380 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-648082f3-1cda-4a0a-8711-174534caf79f req-696df802-08d6-4e50-a218-f2c3d308f331 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056581 Jul 05 10:13:08.835951 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 41/82] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:08.848331 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c005ba1d-d025-4e0e-82b6-1e44fba7a31f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:08.849221 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c005ba1d-d025-4e0e-82b6-1e44fba7a31f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:08.988367 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.001851 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7ae50306-77a3-47b7-89b8-8e2496398724 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.418961 Jul 05 10:13:09.007687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c005ba1d-d025-4e0e-82b6-1e44fba7a31f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.021182 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:08 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:09.022327 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c005ba1d-d025-4e0e-82b6-1e44fba7a31f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1214 microversion: 2.1 time: 0.181932 Jul 05 10:13:09.023209 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 42/84] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:08 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:09.124853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:09.125494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:09.134894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:09.135363 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:09.136205 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:09.136863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:09.465253 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-88a97039-20da-433c-982a-c0778c1b1b9c req-bdda76ee-cb2e-4793-841e-f7d9bc8e5116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:09.475486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-88a97039-20da-433c-982a-c0778c1b1b9c req-bdda76ee-cb2e-4793-841e-f7d9bc8e5116 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:09.477479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-88a97039-20da-433c-982a-c0778c1b1b9c req-bdda76ee-cb2e-4793-841e-f7d9bc8e5116 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:09.513690 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-88a97039-20da-433c-982a-c0778c1b1b9c req-bdda76ee-cb2e-4793-841e-f7d9bc8e5116 service nova] Creating event network-changed:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:13:09.531577 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-88a97039-20da-433c-982a-c0778c1b1b9c req-bdda76ee-cb2e-4793-841e-f7d9bc8e5116 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069884 Jul 05 10:13:09.532229 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 43/85] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:09.555986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.567789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.569657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.571750 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-133798e4-01db-403d-8c07-06d5d21507b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.451962 Jul 05 10:13:09.572913 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 43/86] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:09 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:09.597823 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:09.599206 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:09.612166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:09.613024 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:09.614151 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:09.615569 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:09.851168 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:09.861353 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8d390b9c-1ff8-4361-b2ee-0f6d1a0f1d80 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.268004 Jul 05 10:13:09.865914 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 44/87] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:09 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:10.037172 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:10.038951 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:10.046026 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.046563 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.047487 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.048079 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.051481 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:10.052705 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:10.061821 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.062578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.063490 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.064060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.158181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:10.168237 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b3b81e88-4b16-4a13-a9e6-769a9db22f0c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1218 microversion: 2.1 time: 0.123025 Jul 05 10:13:10.178483 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:10 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:10.224087 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:10.234308 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd923617-7d07-4af8-a78d-b691b62b9e2c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.201004 Jul 05 10:13:10.235731 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:10 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:10.591474 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:10.592204 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:10.598725 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.599869 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.600739 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.601164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.787364 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:10.797748 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:10.805374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:10.806610 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d00d0a04-d675-431a-a31b-80726c7a4da8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.220268 Jul 05 10:13:10.807231 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 46/90] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:10 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:10.861522 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-c88032cd-d816-490f-8d07-1c4983bdb208 req-146e0087-0800-41d1-a2d2-50b41ed537fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92a9a19-5c0e-4a64-8248-0900ee1578fd", "name": "network-vif-plugged", "status": "completed", "tag": "3a3fce1d-656c-4d35-b526-cc2cacb6c758"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:10.871703 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c88032cd-d816-490f-8d07-1c4983bdb208 req-146e0087-0800-41d1-a2d2-50b41ed537fb service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.872612 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c88032cd-d816-490f-8d07-1c4983bdb208 req-146e0087-0800-41d1-a2d2-50b41ed537fb service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.878855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:10.879773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:10.886135 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-c88032cd-d816-490f-8d07-1c4983bdb208 req-146e0087-0800-41d1-a2d2-50b41ed537fb service nova] Creating event network-vif-plugged:3a3fce1d-656c-4d35-b526-cc2cacb6c758 for instance f92a9a19-5c0e-4a64-8248-0900ee1578fd on hv-cinder-maste Jul 05 10:13:10.888896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.889341 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:10.891608 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-c88032cd-d816-490f-8d07-1c4983bdb208 req-146e0087-0800-41d1-a2d2-50b41ed537fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Jul 05 10:13:10.892193 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 45/91] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:10.894826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:10.894826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.185775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:11.192886 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:11.197392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:11.213510 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.214487 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-383cf0eb-0cfd-4ed0-91d5-c991a4c10ef9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1321 microversion: 2.1 time: 0.337166 Jul 05 10:13:11.215317 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:10 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:11.224924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.225994 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.226937 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.254857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:11.255741 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:11.268023 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.269591 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.272447 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.273039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.363953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:11.378514 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-64ee3862-88e8-4314-af43-a9598ccd137b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1266 microversion: 2.1 time: 0.197200 Jul 05 10:13:11.379102 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 46/93] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:11 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:11.545329 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:11.565386 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-63040fec-a70d-481a-a1f8-85c3dc86af0c tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.311720 Jul 05 10:13:11.566724 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 48/94] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:11 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:11.825462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:11.826959 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:11.839654 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.840210 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:11.841024 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:11.841538 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.233707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:12.234394 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:12.244764 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.246808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.247806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.248382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.270084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:12.282528 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:12.284269 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:12.287831 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-16258cc6-387e-4ed0-8225-d92369c1c826 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.466560 Jul 05 10:13:12.294296 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 47/95] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:11 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:12.396053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:12.397092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:12.405236 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.405829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.406928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.407499 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.483051 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:12.492680 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70a1389c-298c-443c-ae11-55be2b9cb96b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1272 microversion: 2.1 time: 0.100491 Jul 05 10:13:12.494460 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 48/96] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:12 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1272 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:12.495413 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:12.503809 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1571a00d-0d11-4427-acdd-9eb800c2a723 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1515 microversion: 2.1 time: 0.275754 Jul 05 10:13:12.504373 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 49/97] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:12 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:12.520709 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:12.521874 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:12.528523 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.529165 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.530192 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.530789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.583721 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:12.588448 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:12.588631 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:12.598238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'flavor' on Instance uuid eea4c03a-7d8a-4595-a5a7-e70971848db7 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:13:12.644977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.645444 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.653746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.657712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.777857 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cc96217f-f40c-4e2f-9a60-687f907ec0ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7/action" status: 200 len: 32 microversion: 2.1 time: 0.261091 Jul 05 10:13:12.778699 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 49/98] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:13:12 2022] POST /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:13:12.793272 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:12.794268 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:12.804933 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.805624 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:12.807315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:12.807922 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:13.230350 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.239227 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-86b3f806-dc25-4975-b586-d0855fc8aae2 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.450930 Jul 05 10:13:13.254942 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:12 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:13.298527 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.312065 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:13.312757 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:13.316846 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2c5136c8-0fd7-4251-bcb9-c6af9fbc7c09 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1315 microversion: 2.1 time: 0.737532 Jul 05 10:13:13.320630 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:12 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:13.322614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:13.323375 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:13.324457 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:13.324958 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:13.514763 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:13.515533 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:13.532325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:13.534905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:13.535945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:13.536522 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:13.650529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.657374 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.658492 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7090ac13-ed16-4d44-8258-902550e0838a tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1272 microversion: 2.1 time: 0.151273 Jul 05 10:13:13.659362 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:13 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:13.666018 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.669030 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:13.670152 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c71b8c17-d612-4606-990c-8b27da451e4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.362442 Jul 05 10:13:13.670836 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 51/102] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:13 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:13:14.270270 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:14.271207 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:14.279822 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.280274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.281049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.281506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.337200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:14.338026 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:14.347013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.353195 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.354273 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.354968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.907922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:14.917856 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0de61479-cd57-4034-ba50-b24a54b7d76c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.658715 Jul 05 10:13:14.918788 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 52/103] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:14 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:14.924129 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:14.924728 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:14.929452 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:14.932878 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.933341 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.935194 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.936409 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.939865 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a766ba67-26f2-4097-b061-7aafee6400fb tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1502 microversion: 2.1 time: 0.606525 Jul 05 10:13:14.941376 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:14 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1502 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:14.948053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:14.948998 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:14.957055 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.957572 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:14.958470 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:14.958968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:15.313723 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:15.323747 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-27231c02-f72e-4169-9098-f2e66aa85c2b tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.403760 Jul 05 10:13:15.324608 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 53/105] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:14 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:15.329472 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-4018a6f4-7fc9-4751-8e97-4300567d3804 req-186cf19e-daad-476a-833e-14094bbdb162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70720c19-3804-48c1-b919-cf5ccdc5414c", "tag": "a519f69c-d21d-4297-a3ac-91b9e4505a9a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:15.338617 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4018a6f4-7fc9-4751-8e97-4300567d3804 req-186cf19e-daad-476a-833e-14094bbdb162 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:15.339109 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4018a6f4-7fc9-4751-8e97-4300567d3804 req-186cf19e-daad-476a-833e-14094bbdb162 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:15.349361 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:15.355084 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-4018a6f4-7fc9-4751-8e97-4300567d3804 req-186cf19e-daad-476a-833e-14094bbdb162 service nova] Creating event network-changed:a519f69c-d21d-4297-a3ac-91b9e4505a9a for instance 70720c19-3804-48c1-b919-cf5ccdc5414c on hv-cinder-maste Jul 05 10:13:15.359202 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:15.369150 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-4018a6f4-7fc9-4751-8e97-4300567d3804 req-186cf19e-daad-476a-833e-14094bbdb162 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035703 Jul 05 10:13:15.369150 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 54/106] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:15.378774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:15.380077 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-80e4375d-20d7-4c54-8930-0f94efcbdf77 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.437555 Jul 05 10:13:15.382209 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 53/107] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:14 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:15.938926 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:15.939638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:15.946369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:15.946813 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:15.947568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:15.947999 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:16.081633 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:16.089967 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3feeb939-a427-48f6-be88-8a8dd615ca0a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.158747 Jul 05 10:13:16.090590 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 55/108] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:15 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:16.345362 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:16.346091 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:16.352953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:16.353552 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:16.354173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:16.354614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:16.399215 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:16.400059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:16.406945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:16.407687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:16.408896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:16.409712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:16.414889 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:16.433166 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:16.545271 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:16.572032 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b5b33baf-245f-4dcf-b053-a4cba8e99a23 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.231906 Jul 05 10:13:16.572809 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:16 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:16.617894 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:16.639051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:16.640754 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:16.645476 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-06a6a0c6-9b6c-49f9-92be-b49ae48fd2db tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.250362 Jul 05 10:13:16.647175 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 56/110] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:16 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:13:17.107701 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:17.108525 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:17.115346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.115777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.116901 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.117384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.303298 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:17.314867 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-194730f4-15a6-47ff-9177-13b8ee8a3a59 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.210343 Jul 05 10:13:17.322422 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 55/111] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:17 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:17.589531 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:17.590166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:17.596404 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.596838 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.597641 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.598067 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.665346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:17.666028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:17.681132 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.682676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.683586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.684479 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.899060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:17.909756 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b8bc3f3a-9b91-4ecb-a466-e3c18b581fde tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.323969 Jul 05 10:13:17.911871 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 57/112] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:17 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:17.917572 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fce27b3-5cb7-4213-a7c7-4ac1c6490bab"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:17.919376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:17.934881 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.937334 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.938478 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:17.938952 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:17.997008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:18.006380 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:18.007649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:18.008762 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-16cf8210-f206-4f99-a8ee-f7332b5b4e9f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.347574 Jul 05 10:13:18.019440 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 56/113] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:17 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:18.332279 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:18.333224 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:18.345913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:18.347319 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:18.348083 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:18.348521 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:18.511570 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-35d83b56-ded9-4af6-952e-fbfa2d20dcf7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "POST /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597993 Jul 05 10:13:18.518314 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 58/114] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:13:17 2022] POST /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd/os-volume_attachments => generated 194 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:18.606537 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:18.625201 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3d2dbc10-f4ae-4d86-883e-8a59f1e8dc61 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.296625 Jul 05 10:13:18.628396 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 57/115] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:18 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:18.928832 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:18.929599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:18.932216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:18.938961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:18.939406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:18.940223 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:18.940694 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:19.014493 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=8 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:19.029411 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:19.030757 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:19.041589 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:19.042158 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:19.043943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:19.044547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:19.114376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:19.123412 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c42e820c-08ee-46a5-b28a-57376c1b6837 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.199015 Jul 05 10:13:19.124300 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:18 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:19.210653 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:19.223860 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:19.226586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:19.228044 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-934b0c5f-9c52-4d46-816f-664abd7d1fb5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.204528 Jul 05 10:13:19.228796 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 58/117] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:19 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:13:19.652186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:19.654916 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:19.665036 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:19.670888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:19.675923 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:19.677585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:19.965400 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:19.975236 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d417d384-4baf-4c09-b241-58c9493a5cd0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.335085 Jul 05 10:13:19.976685 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:19 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:20.142531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:20.143278 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:20.163049 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:20.163979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:20.166821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:20.167492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:20.251417 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:20.252074 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:20.266627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:20.267444 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:20.268445 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:20.270021 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:20.330115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:20.340129 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2c22ac28-d348-459e-859d-87d4446df260 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.202720 Jul 05 10:13:20.341851 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 59/119] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:20 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:20.574889 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:20.583858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:20.585833 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:20.586876 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d506e9ff-7bf8-40df-94f1-a7ea7a26d9d5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.342500 Jul 05 10:13:20.587430 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 61/120] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:20 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:20.994096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:20.994881 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:21.001471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.002259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.003241 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.003930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.175205 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:21.184314 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-34a4acbc-4d07-459b-b3b7-c6106403abbd tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.194439 Jul 05 10:13:21.185219 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 60/121] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:20 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:21.360346 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:21.360977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:21.368103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.369078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.370837 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.371455 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.545192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:21.559957 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7f5cdfcf-04a8-406d-a434-5688f9547bdd tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.203074 Jul 05 10:13:21.561504 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 62/122] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:21 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:21.605798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:21.606492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:21.617190 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.617657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.619253 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:21.621948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:21.841572 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:21.851145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:21.853303 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:21.855128 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-29c02a4c-47d6-4099-94ce-87f03ca24799 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.253726 Jul 05 10:13:21.856215 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 61/123] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:21 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:21.996671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-11719ee6-80bd-45c6-80ca-4a7f889879b8 req-0805acf6-3c4f-48b8-849b-f525354c4d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "name": "network-vif-plugged", "status": "completed", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:22.006270 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-11719ee6-80bd-45c6-80ca-4a7f889879b8 req-0805acf6-3c4f-48b8-849b-f525354c4d58 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.007265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-11719ee6-80bd-45c6-80ca-4a7f889879b8 req-0805acf6-3c4f-48b8-849b-f525354c4d58 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.019915 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-11719ee6-80bd-45c6-80ca-4a7f889879b8 req-0805acf6-3c4f-48b8-849b-f525354c4d58 service nova] Creating event network-vif-plugged:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:13:22.024824 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-11719ee6-80bd-45c6-80ca-4a7f889879b8 req-0805acf6-3c4f-48b8-849b-f525354c4d58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 Jul 05 10:13:22.025420 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 63/124] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:22.201044 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:22.201689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:22.209755 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.210432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.211209 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.211916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.438959 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:22.448828 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5c42bcbb-a31f-4e7f-b592-06d491679ef6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.250976 Jul 05 10:13:22.459439 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 62/125] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:22 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:22.580392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:22.581112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:22.591379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.592336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.593441 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.594746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.762727 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:22.774278 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aa64f9c6-df84-4eb0-a956-5ceb158a476d tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.198936 Jul 05 10:13:22.775494 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 64/126] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:22 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:22.874134 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:22.874775 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:22.880810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.881259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:22.882018 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:22.882631 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:23.037997 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:23.053118 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:23.054989 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:23.056213 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e6ba8be0-6976-4634-b6e5-73ebfa10e171 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.186765 Jul 05 10:13:23.056765 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 63/127] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:22 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:23.219516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1521938204", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:23.307801 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] validate_networks() for None {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:13:23.465723 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:23.466984 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:23.478871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:23.479789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:23.482044 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:23.483948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:23.495577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:24.161903 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:13:24.162415 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:13:24.162812 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:13:24.163418 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:13:24.164140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:13:24.172777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.174290 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.175079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.176002 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.176559 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.191300 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7bf773a6-bba0-4ccf-819d-79440d818895 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.728304 Jul 05 10:13:24.192812 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 64/128] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:23 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:24.197736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Getting quotas for project 1ad13e7306d74bb68b895ec28c1bfd3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:13:24.206524 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Getting quotas for user bb41d8ee37f8426d9ac14efbbda441a5 and project 1ad13e7306d74bb68b895ec28c1bfd3c. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:13:24.206801 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:24.208011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:24.219106 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.219576 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.220347 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.220761 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.234671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:13:24.274431 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:13:24.363146 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-04ea82e1-75a0-4ba7-8597-e493921d8d61 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150093 Jul 05 10:13:24.366206 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 65/129] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:13:24.378309 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:24.379735 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:24.387898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.388820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.389794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.390414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.456994 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.465968 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-616b3c99-4076-4f1f-8b3c-ae8bb225992c tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.270872 Jul 05 10:13:24.466749 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 65/130] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:24 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:24.481832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:24.482671 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:24.490271 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.490991 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.492250 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.492981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.554906 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:13:24.727724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.740538 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.745144 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.747119 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dbcb2063-6b03-4669-a480-bc074363b00b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.378731 Jul 05 10:13:24.760818 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 66/131] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:24 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:24.774302 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6ac947b2-d8e8-452c-b5be-1d864b93c686 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:24.776761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6ac947b2-d8e8-452c-b5be-1d864b93c686 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:24.789548 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6b1e535e-43cb-404c-9cb8-cddf605b92f7 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 204 len: 0 microversion: 2.1 time: 0.312118 Jul 05 10:13:24.790330 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 66/132] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:13:24 2022] DELETE /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:13:24.810103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:24.810834 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:24.836203 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.843059 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.844092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:24.844597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:24.900135 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6ac947b2-d8e8-452c-b5be-1d864b93c686 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:24.909594 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6ac947b2-d8e8-452c-b5be-1d864b93c686 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1215 microversion: 2.1 time: 0.147097 Jul 05 10:13:24.912667 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 67/133] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:24 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1215 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:25.046790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.055527 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-13f05431-336c-4c55-92fa-d493bc89361b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1554 microversion: 2.1 time: 0.260899 Jul 05 10:13:25.056105 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 67/134] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:24 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:25.209453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:25.210952 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:25.217566 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.218365 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.219416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.219984 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.370730 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.381119 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99a1deb1-e3d1-4b86-8127-aac681cc333d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.175796 Jul 05 10:13:25.382679 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:25 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:25.484037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:25.484634 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:25.491787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.492211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.492957 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.493412 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.709967 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.721583 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-76ee8f60-45ff-4b6b-b822-30f7a175c9ee tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.241671 Jul 05 10:13:25.722266 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 68/136] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:25 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:25.778747 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:25.779323 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:25.786152 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.786641 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.787399 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.787986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.928583 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:25.929373 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:25.939935 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.943195 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.944171 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:25.944712 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:25.978849 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.988483 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.990451 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:25.991707 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a463a03b-9421-486d-8b8d-40379645ce14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.217175 Jul 05 10:13:25.993055 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 69/137] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:25 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:26.039446 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:26.047662 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-19383ee9-3b34-46ec-b787-deb476ef419c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1219 microversion: 2.1 time: 0.123462 Jul 05 10:13:26.057074 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 69/138] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:25 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:26.074170 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:26.074981 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:26.084313 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.085101 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.086239 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.087467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.179306 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-c19dd7c7-360a-4ea0-b0da-3f786ac7b23f req-7a707255-8678-4bd2-96d9-bdcea02d965c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70720c19-3804-48c1-b919-cf5ccdc5414c", "name": "network-vif-plugged", "status": "completed", "tag": "a519f69c-d21d-4297-a3ac-91b9e4505a9a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:26.195890 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c19dd7c7-360a-4ea0-b0da-3f786ac7b23f req-7a707255-8678-4bd2-96d9-bdcea02d965c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.196479 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c19dd7c7-360a-4ea0-b0da-3f786ac7b23f req-7a707255-8678-4bd2-96d9-bdcea02d965c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.221168 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-c19dd7c7-360a-4ea0-b0da-3f786ac7b23f req-7a707255-8678-4bd2-96d9-bdcea02d965c service nova] Creating event network-vif-plugged:a519f69c-d21d-4297-a3ac-91b9e4505a9a for instance 70720c19-3804-48c1-b919-cf5ccdc5414c on hv-cinder-maste Jul 05 10:13:26.231156 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-c19dd7c7-360a-4ea0-b0da-3f786ac7b23f req-7a707255-8678-4bd2-96d9-bdcea02d965c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057506 Jul 05 10:13:26.231771 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 70/139] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:13:26.260276 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:26.270172 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e6ca5e54-2d79-4d50-b447-00c7fb482d3b tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1554 microversion: 2.1 time: 0.201085 Jul 05 10:13:26.275392 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 70/140] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:26 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:26.401442 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:26.402163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:26.408688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.409460 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.410433 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.411012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.573430 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:26.593138 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d032300a-c8a8-4c09-8bf2-779332a9093a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.197359 Jul 05 10:13:26.594806 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 71/141] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:26 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:26.741777 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:26.742611 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:26.747049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:26.767461 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.767461 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.774065 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:26.774959 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:26.939906 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:26.957069 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2ab2b110-85c6-4cce-84ed-1bd3b9a6ee8f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.215647 Jul 05 10:13:26.968129 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 71/142] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:26 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:27.020158 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:27.022126 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:27.032005 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.036990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.038694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.039537 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.065539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:27.066498 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:27.084327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.084778 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.085709 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.086144 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.194880 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.212986 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f34b2955-a8ef-4b4d-8dee-10689f16465e tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1219 microversion: 2.1 time: 0.151848 Jul 05 10:13:27.213656 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 72/143] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:27 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:27.266659 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.275097 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.276935 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.278060 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-84e97c44-cb67-4b40-86a9-48a4060587d7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1408 microversion: 2.20 time: 0.270551 Jul 05 10:13:27.278779 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 72/144] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:27 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:27.287347 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:27.290561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:27.297278 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.297711 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.298657 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.299149 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.440547 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.444843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:27.453391 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4153c7d-9352-4fac-8b0c-379ee5b78659 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1554 microversion: 2.1 time: 0.169676 Jul 05 10:13:27.454615 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 73/145] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:27 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:27.621082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:27.626365 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:27.632835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.635571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.636551 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.636993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.842089 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:27.850616 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cecae3a7-5b6c-4f4c-92e6-ba4954667670 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.242902 Jul 05 10:13:27.851180 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 73/146] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:27 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:27.975942 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:27.976550 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:27.996277 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.996834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:27.997697 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:27.998245 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.171573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.182763 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8e8847f0-3ffc-43fe-be84-e31c936835c8 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.211541 Jul 05 10:13:28.183881 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 74/147] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:27 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:28.230581 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:28.231381 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:28.238659 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.239439 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.240621 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.241267 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.297132 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:28.297731 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:28.305567 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.306288 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.307755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.309901 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.329161 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.343412 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0655b71c-c475-4b9a-8cdc-a6bd5e2dd3b9 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1211 microversion: 2.1 time: 0.117299 Jul 05 10:13:28.344415 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 74/148] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:28 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:28.473516 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:28.474125 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:28.480953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.481601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.482425 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.482848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.561388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.574542 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.576796 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.578042 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ad0edcc3-8336-43d4-a92e-e5951e74a1b5 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1599 microversion: 2.20 time: 0.284851 Jul 05 10:13:28.579350 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 75/149] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:13:28 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1599 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:13:28.632468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:28.633453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:28.639867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.640619 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.641581 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.642020 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.689968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:28.698285 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-02f2e080-fe3e-4bf2-85e7-161257b0d9e2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1554 microversion: 2.1 time: 0.230559 Jul 05 10:13:28.698861 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 75/150] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:28 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:28.727249 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fe9b6df4-cc0a-4ad7-af82-0ed9df9e72b7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127023 Jul 05 10:13:28.728370 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 76/151] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jul 5 10:13:28 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:13:28.869992 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:28.870934 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:28.878037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.878725 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:28.879825 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:28.880399 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.200961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:29.201816 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:29.209088 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.209817 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.210934 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.211546 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.414307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:29.423442 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-107c557f-d8f4-4631-a52d-cdebeaf0cf33 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.559366 Jul 05 10:13:29.424246 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 76/152] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:28 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:29.442480 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:29.443094 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:29.453111 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.453615 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.454400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.455013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.587598 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:29.596797 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f1ed7847-4301-42d6-98b5-a13270b6a63b tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1285 microversion: 2.1 time: 0.161330 Jul 05 10:13:29.597381 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 77/153] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:29 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:29.715315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:29.715956 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:29.719269 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:29.722837 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.723282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.724045 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:29.724471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:29.972126 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:29.979785 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5b7f7f95-3e97-4776-a7d0-4a50d887c723 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1314 microversion: 2.1 time: 0.783279 Jul 05 10:13:29.980610 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 77/154] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:29 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:29.994837 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-fd6c46b4-98f2-4ec0-964f-184c82950ac3 req-6cdf77d5-12c2-40f5-b6ec-904baa3dd2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92a9a19-5c0e-4a64-8248-0900ee1578fd", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3fce1d-656c-4d35-b526-cc2cacb6c758"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:30.003574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fd6c46b4-98f2-4ec0-964f-184c82950ac3 req-6cdf77d5-12c2-40f5-b6ec-904baa3dd2f8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:30.004005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fd6c46b4-98f2-4ec0-964f-184c82950ac3 req-6cdf77d5-12c2-40f5-b6ec-904baa3dd2f8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:30.018676 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-fd6c46b4-98f2-4ec0-964f-184c82950ac3 req-6cdf77d5-12c2-40f5-b6ec-904baa3dd2f8 service nova] Creating event network-vif-unplugged:3a3fce1d-656c-4d35-b526-cc2cacb6c758 for instance f92a9a19-5c0e-4a64-8248-0900ee1578fd on hv-cinder-maste Jul 05 10:13:30.024315 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-fd6c46b4-98f2-4ec0-964f-184c82950ac3 req-6cdf77d5-12c2-40f5-b6ec-904baa3dd2f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033617 Jul 05 10:13:30.025301 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 78/155] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:30.442011 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:30.444048 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:30.450743 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:30.451530 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:30.452530 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:30.453800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:30.504641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:30.514193 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8ab2303a-4ad6-4627-80b2-e074b916e185 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1554 microversion: 2.1 time: 0.802787 Jul 05 10:13:30.524010 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 78/156] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:29 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1554 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:30.617183 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:30.618117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:30.625999 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:30.626458 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:30.628584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:30.629014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:30.796023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:30.808812 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:30.825689 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0e0a3bb0-9200-4fd9-b00e-c127cf623d6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1273 microversion: 2.1 time: 0.214656 Jul 05 10:13:30.827594 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 79/157] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:30 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1273 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:30.994725 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:30.997113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:30.997796 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:31.006770 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8dfe5461-e811-46e8-b9c7-81f9bf0e09c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.569455 Jul 05 10:13:31.016229 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 79/158] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:30 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:31.016229 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-826c037e-a07a-4c47-9cb1-9b418413341c req-5567397b-3435-4de0-b666-c9772562e2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92a9a19-5c0e-4a64-8248-0900ee1578fd", "name": "network-vif-deleted", "tag": "3a3fce1d-656c-4d35-b526-cc2cacb6c758"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:31.016554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.016554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.025791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.026283 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.041749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-826c037e-a07a-4c47-9cb1-9b418413341c req-5567397b-3435-4de0-b666-c9772562e2a5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.051049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-826c037e-a07a-4c47-9cb1-9b418413341c req-5567397b-3435-4de0-b666-c9772562e2a5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.069518 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-826c037e-a07a-4c47-9cb1-9b418413341c req-5567397b-3435-4de0-b666-c9772562e2a5 service nova] Creating event network-vif-deleted:3a3fce1d-656c-4d35-b526-cc2cacb6c758 for instance f92a9a19-5c0e-4a64-8248-0900ee1578fd on hv-cinder-maste Jul 05 10:13:31.087273 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-826c037e-a07a-4c47-9cb1-9b418413341c req-5567397b-3435-4de0-b666-c9772562e2a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076906 Jul 05 10:13:31.088062 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 80/159] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:31.492492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:31.504904 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-682e9868-c96b-4f65-a9f9-d5a0b9915965 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1498 microversion: 2.1 time: 0.511760 Jul 05 10:13:31.505555 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 80/160] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:30 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1498 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:31.532514 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:31.533212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:31.543962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.544424 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.545255 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.555000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.801561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d4bb910a5bc4c7ea2667dc65066b2bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf8cdaba37244ff9bcf6df35373f1467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:31.816368 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6cf65472-e135-41be-98a1-c4991edc65a5 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 200 len: 1346 microversion: 2.1 time: 0.285042 Jul 05 10:13:31.818082 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:31 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 1346 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:31.845008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:31.845698 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:31.867003 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.868276 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:31.869498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:31.873211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.025908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:32.026612 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:32.042509 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:32.044921 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.048428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:32.050994 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.585987 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:32.596716 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:32.597190 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-46fa78de-6b45-48b0-b362-2c92e9e8f94c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.756409 Jul 05 10:13:32.606651 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:31 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:32.608065 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b353767e-d5d3-4789-9969-1573c6c68ead tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.586581 Jul 05 10:13:32.608065 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 82/163] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:32 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:32.842475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:32.843813 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:32.853380 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:32.854312 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.856553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:32.857245 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.875235 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] HTTP exception thrown: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Request method failure captured: Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd HTTP/1.1 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6UsvENGOMCASbwyCB3b2Kc4PMrUSMZhF9lRhFhU6nGqMnm6WP2IeBJAPzkcQeZpAugxYitOOeOEJEDuGlbur34QjJuoqDDs1KEiQyGjRDiOiUhOw7fBZt_1vGAegUehr3PddHrX6vA7WhqJ2WTRe7q3rowuWm3eQbvzuFKO2GyY6M Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:13:32.882712 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 7d4bb910a5bc4c7ea2667dc65066b2bd Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:32.884038 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'f92a9a19-5c0e-4a64-8248-0900ee1578fd'} Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:32.884764 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:32.886729 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:32.891178 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Returning 404 to user: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:32.892009 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4bc779c6-a629-4186-9d64-7595d1663cc8 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 404 len: 111 microversion: 2.1 time: 0.061028 Jul 05 10:13:32.893312 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:32 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:32.952560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9e7b26bf-030a-49ab-9913-6620c3220698 req-88ccd749-dc4d-4af8-82fe-8822e3fd195d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc2b7af-b5c6-4de6-916f-6a52546e71a0", "tag": "9f99bca6-e6d7-4264-b052-d5582d4d374a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:32.963316 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9e7b26bf-030a-49ab-9913-6620c3220698 req-88ccd749-dc4d-4af8-82fe-8822e3fd195d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:32.963794 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9e7b26bf-030a-49ab-9913-6620c3220698 req-88ccd749-dc4d-4af8-82fe-8822e3fd195d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:32.986373 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9e7b26bf-030a-49ab-9913-6620c3220698 req-88ccd749-dc4d-4af8-82fe-8822e3fd195d service nova] Creating event network-changed:9f99bca6-e6d7-4264-b052-d5582d4d374a for instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 on hv-cinder-maste Jul 05 10:13:32.991705 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9e7b26bf-030a-49ab-9913-6620c3220698 req-88ccd749-dc4d-4af8-82fe-8822e3fd195d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047704 Jul 05 10:13:32.992499 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 82/165] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:33.119631 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-4f94600f-db29-4395-971b-3e613dc1793d req-17b11b40-82d8-41d7-b714-72967f9a5e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:33.143350 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4f94600f-db29-4395-971b-3e613dc1793d req-17b11b40-82d8-41d7-b714-72967f9a5e72 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.145167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4f94600f-db29-4395-971b-3e613dc1793d req-17b11b40-82d8-41d7-b714-72967f9a5e72 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.179299 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-4f94600f-db29-4395-971b-3e613dc1793d req-17b11b40-82d8-41d7-b714-72967f9a5e72 service nova] Creating event network-changed:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:13:33.193583 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-4f94600f-db29-4395-971b-3e613dc1793d req-17b11b40-82d8-41d7-b714-72967f9a5e72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078570 Jul 05 10:13:33.195436 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 84/166] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:33.234025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:33.238053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:33.252577 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.260463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.261803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.262442 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.285546 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] HTTP exception thrown: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Request method failure captured: Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd/os-volume_attachments HTTP/1.1 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6UsvENGOMCASbwyCB3b2Kc4PMrUSMZhF9lRhFhU6nGqMnm6WP2IeBJAPzkcQeZpAugxYitOOeOEJEDuGlbur34QjJuoqDDs1KEiQyGjRDiOiUhOw7fBZt_1vGAegUehr3PddHrX6vA7WhqJ2WTRe7q3rowuWm3eQbvzuFKO2GyY6M Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:13:33.295882 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 7d4bb910a5bc4c7ea2667dc65066b2bd Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:33.297241 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'server_id': 'f92a9a19-5c0e-4a64-8248-0900ee1578fd'} Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:33.298054 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:33.299226 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:33.306729 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Returning 404 to user: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:33.316545 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c667f7e-6d91-4c77-9811-7d2fa2281bb2 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.087123 Jul 05 10:13:33.319160 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:13:33 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd/os-volume_attachments => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:33.616063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:33.616802 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:33.629537 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:33.630656 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:33.653843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.654328 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.655114 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.655550 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.655894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.656505 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.658256 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:33.659229 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:33.973235 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:33.975449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:33.982404 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7f873573-ac1a-4f38-aed2-4c0b85221ebf tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.370828 Jul 05 10:13:33.983279 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 85/168] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:33 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:33.987129 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-71fb6341-df19-4cac-9864-328409a62767 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.367826 Jul 05 10:13:33.987708 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:33 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:35.001148 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.002110 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.004100 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:35.004772 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.005318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=8 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:35.005539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.011601 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.012192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.012311 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.012745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.012955 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.013378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.013495 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.013910 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.241481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:35.251368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:35.253276 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd688e11-3cfe-47e7-8a62-4adff0e9731f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.252449 Jul 05 10:13:35.262696 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 85/170] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:34 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:35.262696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.262696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.263096 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e87a5c37-2031-4ca8-a6f0-44a987e68fca tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.266312 Jul 05 10:13:35.265377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.266281 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 86/171] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:34 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:35.274661 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.275612 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.276140 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.291470 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] HTTP exception thrown: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Request method failure captured: Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd HTTP/1.1 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6UsvENGOMCASbwyCB3b2Kc4PMrUSMZhF9lRhFhU6nGqMnm6WP2IeBJAPzkcQeZpAugxYitOOeOEJEDuGlbur34QjJuoqDDs1KEiQyGjRDiOiUhOw7fBZt_1vGAegUehr3PddHrX6vA7WhqJ2WTRe7q3rowuWm3eQbvzuFKO2GyY6M Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:13:35.293728 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 7d4bb910a5bc4c7ea2667dc65066b2bd Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.295005 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': 'f92a9a19-5c0e-4a64-8248-0900ee1578fd'} Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:35.295761 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.299815 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.301106 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Returning 404 to user: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:35.301106 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd35bd4a-447f-4a52-90e1-35727ff1e52f tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 404 len: 111 microversion: 2.1 time: 0.039969 Jul 05 10:13:35.301106 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 86/172] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:13:35 2022] DELETE /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:35.303866 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.304473 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] [instance: f92a9a19-5c0e-4a64-8248-0900ee1578fd] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.317357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.317842 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.319197 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.319782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.339144 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] HTTP exception thrown: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Request method failure captured: Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd HTTP/1.1 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6UsvENGOMCASbwyCB3b2Kc4PMrUSMZhF9lRhFhU6nGqMnm6WP2IeBJAPzkcQeZpAugxYitOOeOEJEDuGlbur34QjJuoqDDs1KEiQyGjRDiOiUhOw7fBZt_1vGAegUehr3PddHrX6vA7WhqJ2WTRe7q3rowuWm3eQbvzuFKO2GyY6M Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:13:35.340789 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cf8cdaba37244ff9bcf6df35373f1467"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: cf8cdaba37244ff9bcf6df35373f1467 Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-DeleteServersTestJSON-619102732 Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 7d4bb910a5bc4c7ea2667dc65066b2bd Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-DeleteServersTestJSON-619102732-project Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.341942 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'f92a9a19-5c0e-4a64-8248-0900ee1578fd'} Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:35.342687 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. Jul 05 10:13:35.343807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:35.344987 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] Returning 404 to user: Instance f92a9a19-5c0e-4a64-8248-0900ee1578fd could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:35.344987 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0d425d26-520f-43f7-97b2-1a660895f551 tempest-DeleteServersTestJSON-619102732 tempest-DeleteServersTestJSON-619102732-project] 10.222.0.16 "GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd" status: 404 len: 111 microversion: 2.1 time: 0.042406 Jul 05 10:13:35.344987 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 87/173] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:35 2022] GET /compute/v2.1/servers/f92a9a19-5c0e-4a64-8248-0900ee1578fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:35.472389 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.472998 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.486431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.487539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.489125 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.489774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.527696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:13:35.642308 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-55f4d02d-5cf8-477c-a2c7-12c1de6a12c9 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "DELETE /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 204 len: 0 microversion: 2.1 time: 0.173659 Jul 05 10:13:35.653446 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 87/174] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:13:35 2022] DELETE /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:13:35.661106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:35.662611 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:35.677063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.677803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.678951 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:35.679809 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:35.955570 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:35.965435 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4dda4dec-49ed-4452-bcc6-c965a451f3e2 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1504 microversion: 2.1 time: 0.310805 Jul 05 10:13:35.966520 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 88/175] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:35 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:36.271704 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:36.272489 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:36.279771 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.280633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:36.281736 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.282339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:36.287014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:36.287638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:36.296065 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.296661 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:36.297667 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.298145 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:36.626173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:36.634472 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f9f87ff5-31f3-4aac-a6fc-e3d222c6e14d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.367513 Jul 05 10:13:36.635067 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 88/176] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:36 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:36.642192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:36.650413 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5bcfb965-5372-4114-8b46-dee328ae0b6a tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.372424 Jul 05 10:13:36.651268 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 89/177] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:36 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:36.984855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:36.985586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:36.992771 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.993301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:36.994181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:36.994869 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:37.275763 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:37.285003 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-22efb331-7581-4807-b94a-a4038ce8d6f5 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1504 microversion: 2.1 time: 0.305080 Jul 05 10:13:37.286458 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 89/178] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:36 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:37.652147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:37.653501 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:37.660398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:37.661139 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:37.667305 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:37.668177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:37.672780 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:37.675549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:37.678736 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:37.681683 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:37.694145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:37.695831 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:37.901696 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:37.914696 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6f39a675-6866-4acb-aaaa-8fb08207a159 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.266850 Jul 05 10:13:37.917305 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:37 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:38.020271 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:38.034854 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-256830cd-5295-41cb-a330-440808e8c196 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.370948 Jul 05 10:13:38.043940 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:37 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:38.306410 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:38.307367 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:38.314998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:38.315843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:38.316853 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:38.317486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:38.514466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:38.529608 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ed1dd08a-11c6-4741-b36f-a45860ae72c4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1504 microversion: 2.1 time: 0.228555 Jul 05 10:13:38.529608 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:38 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:38.931750 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:38.933019 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:38.941254 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:38.941936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:38.942990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:38.943643 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:39.053645 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:39.055398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:39.071644 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:39.079005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:39.079860 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:39.080297 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:39.186332 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:39.197669 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d60d20ce-fec8-48d6-afae-e785bb0bc0c1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.267946 Jul 05 10:13:39.210717 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:38 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:39.379856 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:39.389151 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-32b34d96-eb3c-437a-a257-449cf5a7ab69 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.340449 Jul 05 10:13:39.400309 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 92/183] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:39 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:39.546795 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:39.547488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:39.556065 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:39.556633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:39.557404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:39.557827 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:39.759768 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:39.775882 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7fa7552a-c24a-47b2-8744-2fbb99f1094f tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1504 microversion: 2.1 time: 0.233144 Jul 05 10:13:39.776586 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 92/184] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:39 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1504 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:40.217171 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:40.217754 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:40.224700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.225150 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.225908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.226371 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.418855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:40.419471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:40.427245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.428282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.429223 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.429798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.705896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:40.719677 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-502b0de9-6148-4ba9-97a0-502944e4709a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.505945 Jul 05 10:13:40.720282 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 93/185] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:40 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:40.736519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-d1371139-fa27-4ed9-8f73-7a40340738ed req-c0cc5928-820b-4952-a17f-1a874db9c625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70720c19-3804-48c1-b919-cf5ccdc5414c", "name": "network-vif-deleted", "tag": "a519f69c-d21d-4297-a3ac-91b9e4505a9a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:40.783401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d1371139-fa27-4ed9-8f73-7a40340738ed req-c0cc5928-820b-4952-a17f-1a874db9c625 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.788863 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d1371139-fa27-4ed9-8f73-7a40340738ed req-c0cc5928-820b-4952-a17f-1a874db9c625 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.795414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:40.806612 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-d1371139-fa27-4ed9-8f73-7a40340738ed req-c0cc5928-820b-4952-a17f-1a874db9c625 service nova] Creating event network-vif-deleted:a519f69c-d21d-4297-a3ac-91b9e4505a9a for instance 70720c19-3804-48c1-b919-cf5ccdc5414c on hv-cinder-maste Jul 05 10:13:40.813858 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-d1371139-fa27-4ed9-8f73-7a40340738ed req-c0cc5928-820b-4952-a17f-1a874db9c625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090358 Jul 05 10:13:40.820616 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 94/186] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:40.829849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:40.841020 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3d98f77b-8deb-4363-afbb-84e4a4d05fd0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.433133 Jul 05 10:13:40.851885 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:40.852188 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 93/187] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:40 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:40.853790 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:40.862773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.863548 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.865629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.866179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.907629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.908465 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.909080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lazy-loading 'fault' on Instance uuid 70720c19-3804-48c1-b919-cf5ccdc5414c {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:13:40.909223 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-b2d71dce-3555-4b5f-9da1-4a16d5980b9f req-596c51b9-b1dd-4945-855c-b81cf31ffe89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc2b7af-b5c6-4de6-916f-6a52546e71a0", "name": "network-vif-plugged", "status": "completed", "tag": "9f99bca6-e6d7-4264-b052-d5582d4d374a"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:40.923498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b2d71dce-3555-4b5f-9da1-4a16d5980b9f req-596c51b9-b1dd-4945-855c-b81cf31ffe89 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:40.924145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-b2d71dce-3555-4b5f-9da1-4a16d5980b9f req-596c51b9-b1dd-4945-855c-b81cf31ffe89 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:40.940993 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-b2d71dce-3555-4b5f-9da1-4a16d5980b9f req-596c51b9-b1dd-4945-855c-b81cf31ffe89 service nova] Creating event network-vif-plugged:9f99bca6-e6d7-4264-b052-d5582d4d374a for instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 on hv-cinder-maste Jul 05 10:13:40.947545 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-b2d71dce-3555-4b5f-9da1-4a16d5980b9f req-596c51b9-b1dd-4945-855c-b81cf31ffe89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043827 Jul 05 10:13:40.949219 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 94/188] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:40.965392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c323490c11b9461898687e729cd357f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a7e4c4e4d154bd9a7197190a9d8b27f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:40.975642 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f8dd822-8cda-4df6-a86c-f5e4b7e87390 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 200 len: 1304 microversion: 2.1 time: 0.137288 Jul 05 10:13:40.982381 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 95/189] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:40 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:41.737455 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:41.738593 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:41.745781 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:41.746361 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:41.747229 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:41.747741 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:41.859010 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:41.860580 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:41.869361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:41.870094 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:41.871614 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:41.872099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:41.970718 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:41.980059 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ebcd80e2-2527-4074-98b3-c1b4b8310fd1 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.246688 Jul 05 10:13:41.981214 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 95/190] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:41 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:41.996177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:41.997122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] [instance: 70720c19-3804-48c1-b919-cf5ccdc5414c] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:42.005771 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:42.006712 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:42.007823 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:42.008649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:42.022805 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] HTTP exception thrown: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Request method failure captured: Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c HTTP/1.1 Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6w8Os737g-V1LEZCXJjYhSLbyiVR8TNGbRaoNFdL82CH7mIqJvXDSYyoKpNeDlW2Rx4d0x_FslipWbMmA1WA-y40KqYSG3oP_AIrcNy5nLAIj3VKhbNgfV2aqa2GYaLiVGNuPtC36W1CtqO38xToDiWSC3iYhe6BKivZ-udqFniBk Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 4a7e4c4e4d154bd9a7197190a9d8b27f Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesActionsTest-162562479 Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:13:42.025160 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4a7e4c4e4d154bd9a7197190a9d8b27f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4a7e4c4e4d154bd9a7197190a9d8b27f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a7e4c4e4d154bd9a7197190a9d8b27f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4a7e4c4e4d154bd9a7197190a9d8b27f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesActionsTest-162562479 Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 4a7e4c4e4d154bd9a7197190a9d8b27f Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesActionsTest-162562479 Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesActionsTest-162562479-project Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: c323490c11b9461898687e729cd357f2 Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesActionsTest-162562479-project Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. Jul 05 10:13:42.026722 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '70720c19-3804-48c1-b919-cf5ccdc5414c'} Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:42.027729 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. Jul 05 10:13:42.029161 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:13:42.031680 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] Returning 404 to user: Instance 70720c19-3804-48c1-b919-cf5ccdc5414c could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:42.032786 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5adf1dec-ed45-4c79-b6df-bfe6973135a4 tempest-VolumesActionsTest-162562479 tempest-VolumesActionsTest-162562479-project] 10.222.0.16 "GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c" status: 404 len: 111 microversion: 2.1 time: 0.041545 Jul 05 10:13:42.033587 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 96/191] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:41 2022] GET /compute/v2.1/servers/70720c19-3804-48c1-b919-cf5ccdc5414c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:42.071962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:42.080329 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5beb9918-6f89-4339-a52a-2a5d8bdad46c tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.227339 Jul 05 10:13:42.081098 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 96/192] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:41 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:43.002057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:43.006084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:43.025327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:43.027730 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:43.028918 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:43.030468 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:43.100495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:43.101811 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:43.117775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:43.119145 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:43.120372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:43.122351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:43.400166 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:43.417045 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fd7f47b8-603b-45aa-8e8a-529c7eeee3eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.417248 Jul 05 10:13:43.417995 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 97/193] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:42 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:43.456556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:43.491429 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0c13f1f4-5692-4261-abea-6f94d0dcb26f tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1315 microversion: 2.1 time: 0.395454 Jul 05 10:13:43.494265 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 97/194] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:43 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:44.434079 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:44.434790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:44.447655 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.448376 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.449457 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.450139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.456285 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:44.510012 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:44.510782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:44.538886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.539583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.544243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.545288 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.860511 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:44.868541 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b0eb1669-bacb-4b0a-bb6c-aba53ca72ca0 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1464 microversion: 2.1 time: 0.362693 Jul 05 10:13:44.870665 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:44 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1464 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:44.907662 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:44.928680 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ac5762f0-d033-4a87-9228-f3f55b2a7335 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.491048 Jul 05 10:13:44.928886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:44.929179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:44.939522 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 98/196] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:44 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:44.949342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.949977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.951353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:44.951803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:44.989889 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:13:45.137911 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-feef5b6c-8bf1-48a7-8447-b2dc8c8193b8 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 204 len: 0 microversion: 2.1 time: 0.214465 Jul 05 10:13:45.139153 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 99/197] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:13:44 2022] DELETE /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 10:13:45.149312 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:45.150453 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:45.159633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:45.160549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:45.161774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:45.162427 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:45.386572 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:45.414259 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70613b18-fab7-4d69-851b-effd43f462cb tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1470 microversion: 2.1 time: 0.270568 Jul 05 10:13:45.416801 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 99/198] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:45 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:45.952643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:45.953211 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:45.967824 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:45.973835 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:45.976356 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:45.977013 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:46.197058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:46.207207 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ec786256-bea7-4841-9967-20f652cc7077 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.262343 Jul 05 10:13:46.208599 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:45 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:46.433833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:46.435191 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:46.443228 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:46.443916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:46.444981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:46.445554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:46.700011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:46.714709 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7e1fcc3d-e4d6-45a4-9559-54bdd95736ad tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1470 microversion: 2.1 time: 0.284908 Jul 05 10:13:46.715830 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 100/200] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:46 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:47.238515 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:47.240688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:47.256082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:47.257322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:47.258344 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:47.259018 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:47.463739 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:47.518158 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-db70c57d-71ff-45f3-a82c-656d21b76a97 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.295510 Jul 05 10:13:47.522075 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 101/201] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:47 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:47.734964 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:47.736265 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:47.745327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:47.746345 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:47.748217 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:47.748970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:48.107662 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb41d8ee37f8426d9ac14efbbda441a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ad13e7306d74bb68b895ec28c1bfd3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:48.118670 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fdb472b2-28cd-4d87-95e4-3b214bc70808 tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 200 len: 1470 microversion: 2.1 time: 0.389283 Jul 05 10:13:48.119898 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 101/202] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:47 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:48.220226 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f345146a-055f-4fd7-809c-43644a36581f req-134e16ab-e9dd-4b1f-b816-1934d8dbc670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc2b7af-b5c6-4de6-916f-6a52546e71a0", "name": "network-vif-deleted", "tag": "9f99bca6-e6d7-4264-b052-d5582d4d374a"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:48.254044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f345146a-055f-4fd7-809c-43644a36581f req-134e16ab-e9dd-4b1f-b816-1934d8dbc670 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:48.255445 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f345146a-055f-4fd7-809c-43644a36581f req-134e16ab-e9dd-4b1f-b816-1934d8dbc670 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:48.273380 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f345146a-055f-4fd7-809c-43644a36581f req-134e16ab-e9dd-4b1f-b816-1934d8dbc670 service nova] Creating event network-vif-deleted:9f99bca6-e6d7-4264-b052-d5582d4d374a for instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 on hv-cinder-maste Jul 05 10:13:48.278816 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f345146a-055f-4fd7-809c-43644a36581f req-134e16ab-e9dd-4b1f-b816-1934d8dbc670 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064123 Jul 05 10:13:48.279905 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 102/203] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:13:48.540348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:48.540962 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:48.550530 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:48.550979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:48.551756 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:48.552184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:48.969725 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:48.983931 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d37686a-a94e-4b4d-8a1b-27af9c464c57 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.447930 Jul 05 10:13:48.989515 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 102/204] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:48 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:49.137640 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:49.138764 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] [instance: 3cc2b7af-b5c6-4de6-916f-6a52546e71a0] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:49.153377 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:49.165577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:49.175305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:49.175867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:49.224203 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] HTTP exception thrown: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Request method failure captured: Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 HTTP/1.1 Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7BDxbi8hLA10oxL3R1Yyxhlxd401ihThr6o-P7LE9tbLkI6kyh9x_9VmoUCp_klfP-COsbtggS8KVO2LlIm4kK4lHd22Z_ac52ejwEsTI_E7814q_XNEQ0g8pCExrlpTp-zjyNDwxTc0DoTPq1qKLBgN8jscwuNNLF6zK3pX3huhE Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 1ad13e7306d74bb68b895ec28c1bfd3c Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-782771801 Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:13:49.231568 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ad13e7306d74bb68b895ec28c1bfd3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ad13e7306d74bb68b895ec28c1bfd3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ad13e7306d74bb68b895ec28c1bfd3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ad13e7306d74bb68b895ec28c1bfd3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-782771801 Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 1ad13e7306d74bb68b895ec28c1bfd3c Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-782771801 Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-782771801-project Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: bb41d8ee37f8426d9ac14efbbda441a5 Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-782771801-project Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. Jul 05 10:13:49.232903 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '3cc2b7af-b5c6-4de6-916f-6a52546e71a0'} Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:13:49.233618 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. Jul 05 10:13:49.235352 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:13:49.241279 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] Returning 404 to user: Instance 3cc2b7af-b5c6-4de6-916f-6a52546e71a0 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:13:49.242530 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8f5ad90a-c390-4880-959c-6dba95531a2d tempest-VolumesNegativeTest-782771801 tempest-VolumesNegativeTest-782771801-project] 10.222.0.16 "GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0" status: 404 len: 111 microversion: 2.1 time: 0.109501 Jul 05 10:13:49.244517 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 103/205] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:49 2022] GET /compute/v2.1/servers/3cc2b7af-b5c6-4de6-916f-6a52546e71a0 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:13:50.006128 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:50.006928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:50.017657 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:50.020927 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:50.021964 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:50.022507 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:50.245702 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:50.254922 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f281a9df-c3c0-4ae1-a5aa-3d6dc2afd4eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.253345 Jul 05 10:13:50.255739 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 104/206] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:50 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:50.278917 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-57c34f6c-37b7-459d-a703-f2e8f096d4bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: .version_select at 0x7ffbf0313ca0>, body: {"keypair": {"name": "tempest-keypair-1406604727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+P4bLBbmRRM/Eavw6LoG2INHACF9Bxx2Zq2fkNDLf+OYejq/VBtY72zaKTshjP5Qlhe3ETngJR38g8pyf1+RRohfc54loMJLgOost/QPYYKq4gvWPjovVZq5gxdztesA=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:50.299175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-57c34f6c-37b7-459d-a703-f2e8f096d4bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:13:50.304848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-57c34f6c-37b7-459d-a703-f2e8f096d4bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:13:50.331545 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-57c34f6c-37b7-459d-a703-f2e8f096d4bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.405083 Jul 05 10:13:50.333199 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 103/207] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:13:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:13:51.272421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:51.273030 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:51.286963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:51.287410 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:51.299468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:51.299921 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:51.639835 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:51.668309 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-636d0ecb-e48f-4f2c-bcd4-55e378fc3f7d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.400260 Jul 05 10:13:51.670813 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 105/208] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:51 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:13:52.687902 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:52.689545 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:52.699017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:52.704840 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:52.707590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:52.716358 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:52.741069 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-694775794", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98b9981-e889-405e-93b5-a13b417620de"}], "security_groups": [{"name": "tempest-securitygroup--446547644"}], "key_name": "tempest-keypair-1406604727", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:52.961773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] validate_networks() for [('c98b9981-e889-405e-93b5-a13b417620de', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:13:53.016266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:53.027402 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f200ac5a-ee76-48d9-9e35-ffe46abbd182 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1521 microversion: 2.1 time: 0.343554 Jul 05 10:13:53.028333 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 104/209] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:52 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:53.522742 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:13:53.523244 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:13:53.523836 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:13:53.524187 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:13:53.524625 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:13:53.539658 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:53.540339 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:53.542147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:53.542686 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:53.571660 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:13:53.576310 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:13:53.591469 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:13:53.595188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:13:53.711505 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0803450e-6491-4996-9af5-cb3d0bd9553a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.975999 Jul 05 10:13:53.712252 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 106/210] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:13:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:13:53.722525 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-75acdb5b-e3cc-4ba0-90a8-f7443ab1f5cc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:53.723148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-75acdb5b-e3cc-4ba0-90a8-f7443ab1f5cc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:53.800518 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-75acdb5b-e3cc-4ba0-90a8-f7443ab1f5cc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:53.808269 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-75acdb5b-e3cc-4ba0-90a8-f7443ab1f5cc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1241 microversion: 2.1 time: 0.089648 Jul 05 10:13:53.809080 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:53 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:54.052797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:54.056636 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:54.070531 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.071051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.071823 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.072452 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.334423 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:54.344582 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ac687ccc-bcd4-40d0-8e11-2ad7ee662147 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1501 microversion: 2.1 time: 0.303113 Jul 05 10:13:54.345963 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:54 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1501 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:54.362516 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:54.363600 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:54.374791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.375476 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.376893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.377475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.577688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:54.590599 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-afc8b3dd-681a-4a3e-bd69-db569e4f53ac tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1516 microversion: 2.1 time: 0.232910 Jul 05 10:13:54.591216 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 106/213] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:54 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:54.827705 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:54.828319 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:54.842238 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.842691 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.845044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:54.845487 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:54.952957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:54.961789 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-89c95c42-5233-4102-9d05-439aee861ef0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1293 microversion: 2.1 time: 0.139060 Jul 05 10:13:54.963333 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 108/214] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:54 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:55.982164 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:55.983549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:55.990968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:55.991559 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:55.992771 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:55.993588 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:56.263912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:56.275031 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a12e0354-9bf2-4373-9802-1a432fbcd0ef tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.298176 Jul 05 10:13:56.276472 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 107/215] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:55 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:57.302584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:57.303200 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:57.305477 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:57.306535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:57.309104 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:13:57.322531 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.322705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.323095 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.323886 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.324319 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.324937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.327855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.328859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.383859 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'flavor' on Instance uuid 6d51ee6e-4926-463c-82fa-66b06c93c8da {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:13:57.578975 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0c80f15b-4428-42ff-a9d9-e96270040559 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/action" status: 200 len: 32 microversion: 2.1 time: 0.277784 Jul 05 10:13:57.579588 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 108/216] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:13:57 2022] POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:13:57.591056 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-70867ffe-3c21-4ef1-a339-3fc1f2c81aae req-fe5bbdf3-9906-4edc-a50e-3edb144c27af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30ebea8-e028-471f-8d15-0513972e2331", "tag": "0bf2d319-5b77-400d-b259-32aa9a04c0d7"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:13:57.618680 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-70867ffe-3c21-4ef1-a339-3fc1f2c81aae req-fe5bbdf3-9906-4edc-a50e-3edb144c27af service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.621163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-70867ffe-3c21-4ef1-a339-3fc1f2c81aae req-fe5bbdf3-9906-4edc-a50e-3edb144c27af service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.651684 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-70867ffe-3c21-4ef1-a339-3fc1f2c81aae req-fe5bbdf3-9906-4edc-a50e-3edb144c27af service nova] Creating event network-changed:0bf2d319-5b77-400d-b259-32aa9a04c0d7 for instance b30ebea8-e028-471f-8d15-0513972e2331 on hv-cinder-maste Jul 05 10:13:57.669191 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-70867ffe-3c21-4ef1-a339-3fc1f2c81aae req-fe5bbdf3-9906-4edc-a50e-3edb144c27af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087385 Jul 05 10:13:57.672328 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 109/217] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:13:57.683790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:57.685808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:57.699275 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.700040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.701594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:57.702853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:57.728554 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:57.756769 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5de4f913-243d-463c-99e8-0e20b8c9c63b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.458470 Jul 05 10:13:57.760084 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:57 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:57.935573 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:57.946985 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-39c5edb9-3ad9-442d-a2da-35a0550643ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.272868 Jul 05 10:13:57.958977 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 110/219] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:57 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:58.780448 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:58.782096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:58.789607 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:58.790128 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:58.794523 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:58.795192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:58.967054 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:13:58.968015 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:13:58.983344 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:58.984719 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:58.985767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:13:58.986477 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:13:59.044145 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:59.052437 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4816ef7-7e9f-4b3b-9a61-6deb40860bbf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.280048 Jul 05 10:13:59.055786 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 110/220] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:58 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:13:59.327189 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:13:59.336349 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fad521b6-08d4-4a9a-8f1e-b585e97a9044 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.374571 Jul 05 10:13:59.337140 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 111/221] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:13:58 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:00.072980 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:00.073763 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:00.081518 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:00.082045 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:00.083337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:00.083818 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:00.105379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:00.352873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:00.353472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:00.355549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:00.360808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:00.361527 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:00.362503 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:00.362933 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:00.366652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:00.386591 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8b60a246-64fc-4b2d-8c66-952297de15ca tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.316633 Jul 05 10:14:00.388029 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 111/222] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:00 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:00.613970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:00.627335 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3dc92e32-4757-4f7f-b4b1-0e5205ea4709 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.278261 Jul 05 10:14:00.628173 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 112/223] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:00 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:01.405379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:01.407656 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:01.419355 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:01.424249 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:01.425440 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:01.427187 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:01.655178 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:01.661536 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:01.681513 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:01.686532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:01.687551 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:01.688139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:02.405717 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:02.415255 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-711eeb8d-d4c7-4495-883b-baafb98087b9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 1.014607 Jul 05 10:14:02.417152 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 112/224] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:01 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:02.573304 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:02.582132 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-01200567-b016-4368-bfd0-d711e941722b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.930652 Jul 05 10:14:02.588550 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 113/225] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:01 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:03.450946 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:03.451663 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:03.469112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:03.469570 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:03.470862 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:03.471332 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:03.557212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:03.586238 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:03.608130 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:03.609856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:03.623382 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:03.625144 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:03.628905 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:03.630642 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:03.805240 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:03.893336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:03.918855 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d6943eac-8eac-4dc9-9b76-fa9f80946cd8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.473398 Jul 05 10:14:03.933928 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 113/226] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:03 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:04.067098 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:04.083399 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d5abe95b-2aac-4c41-b1c0-96547f789e48 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.478121 Jul 05 10:14:04.084029 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:03 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:04.950206 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:04.950819 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:04.965553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:04.967001 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:04.967973 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:04.970826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:05.100693 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:05.102129 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:05.109458 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:05.110275 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:05.111368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:05.112214 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:05.141953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:05.392704 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:05.413647 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9afe1332-1945-43a4-8d5b-a9fc492ea7ad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.467862 Jul 05 10:14:05.415271 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 114/228] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:04 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:05.445954 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:05.458210 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c190b1e-ffdd-4d75-8364-5589789cd472 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.360421 Jul 05 10:14:05.470272 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:05 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:05.715867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f9322f85-ed60-42d9-a8e6-2c20b89cc3f4 req-693280bd-2b5b-4498-bc01-8aa43a8153e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30ebea8-e028-471f-8d15-0513972e2331", "name": "network-vif-plugged", "status": "completed", "tag": "0bf2d319-5b77-400d-b259-32aa9a04c0d7"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:05.738846 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f9322f85-ed60-42d9-a8e6-2c20b89cc3f4 req-693280bd-2b5b-4498-bc01-8aa43a8153e5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:05.740007 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f9322f85-ed60-42d9-a8e6-2c20b89cc3f4 req-693280bd-2b5b-4498-bc01-8aa43a8153e5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:05.791660 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f9322f85-ed60-42d9-a8e6-2c20b89cc3f4 req-693280bd-2b5b-4498-bc01-8aa43a8153e5 service nova] Creating event network-vif-plugged:0bf2d319-5b77-400d-b259-32aa9a04c0d7 for instance b30ebea8-e028-471f-8d15-0513972e2331 on hv-cinder-maste Jul 05 10:14:05.801849 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f9322f85-ed60-42d9-a8e6-2c20b89cc3f4 req-693280bd-2b5b-4498-bc01-8aa43a8153e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089628 Jul 05 10:14:05.804319 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 115/230] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:06.432430 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:06.433200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:06.442188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:06.443328 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:06.444362 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:06.445098 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:06.477858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:06.478570 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:06.488607 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:06.489039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:06.489800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:06.490250 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:06.720834 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:06.734011 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c08691a9-09ff-4aac-9d00-3ad5f7a8aed9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.306469 Jul 05 10:14:06.748546 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 116/231] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:06 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:06.844270 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:06.853269 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a9bf040c-9ced-4d69-b3c3-8115ebcbe296 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.379935 Jul 05 10:14:06.853861 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 116/232] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:06 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:07.765169 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:07.766920 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:07.785626 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:07.786294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:07.787447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:07.788078 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:07.871233 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:07.871957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:07.885084 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:07.886668 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:07.888762 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:07.889400 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:08.242411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:08.252905 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5dfa57cf-d8da-4008-af8d-57434f2a8a0b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.385992 Jul 05 10:14:08.253500 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 117/233] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:07 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:08.259311 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:08.273815 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f61e5e27-0e93-451b-96cd-b87c06207e5f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1366 microversion: 2.1 time: 0.527053 Jul 05 10:14:08.274763 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:07 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:09.270171 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:09.270795 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:09.279375 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.280100 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:09.281315 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.281933 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:09.292554 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:09.294437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:09.311318 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.319195 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:09.320385 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.322349 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:09.665537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:09.690649 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f84b891-0dc5-484f-bd12-b73a9a5c4623 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.424294 Jul 05 10:14:09.698698 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 118/235] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:09 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:09.788795 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:09.797016 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-972656bb-d134-4f43-8207-f0ed6d7f18b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1556 microversion: 2.1 time: 0.510095 Jul 05 10:14:09.797611 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 118/236] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:09 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1556 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:09.816542 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:09.817099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:09.843602 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.845039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:09.846248 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:09.847545 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:10.012706 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-67584096-6e7c-434f-882a-42718bd4fa74 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200039 Jul 05 10:14:10.013867 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 119/237] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:14:09 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:10.720331 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:10.721875 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:10.746262 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:10.748916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:10.753309 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:10.754103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:11.287139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:11.301453 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2d301b9a-ee24-48f3-a6b2-49332bddec75 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.589089 Jul 05 10:14:11.302802 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 119/238] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:10 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:12.320585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:12.321581 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:12.337521 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:12.339779 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:12.340810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:12.342462 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:12.383801 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9f52ceec-a568-4274-9e1e-f13519a6de38 req-bc108ba3-7d9b-4c5f-83cd-a11e91e34670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30ebea8-e028-471f-8d15-0513972e2331", "tag": "0bf2d319-5b77-400d-b259-32aa9a04c0d7"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:12.394738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9f52ceec-a568-4274-9e1e-f13519a6de38 req-bc108ba3-7d9b-4c5f-83cd-a11e91e34670 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:12.395468 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9f52ceec-a568-4274-9e1e-f13519a6de38 req-bc108ba3-7d9b-4c5f-83cd-a11e91e34670 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:12.649860 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9f52ceec-a568-4274-9e1e-f13519a6de38 req-bc108ba3-7d9b-4c5f-83cd-a11e91e34670 service nova] Creating event network-changed:0bf2d319-5b77-400d-b259-32aa9a04c0d7 for instance b30ebea8-e028-471f-8d15-0513972e2331 on hv-cinder-maste Jul 05 10:14:12.655295 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9f52ceec-a568-4274-9e1e-f13519a6de38 req-bc108ba3-7d9b-4c5f-83cd-a11e91e34670 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279078 Jul 05 10:14:12.656266 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 120/239] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:14:12.667805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:12.682692 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-74c3878e-691d-4978-bbe3-51bd47b356fb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.366198 Jul 05 10:14:12.696883 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 120/240] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:12 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:13.703703 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:13.705711 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:13.726855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:13.730854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:13.731987 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:13.734025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:14.115464 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:14.125862 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6ff81b13-6346-491d-957c-47dda460d5c7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.428044 Jul 05 10:14:14.126901 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:13 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:14.346651 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-837d7063-33d0-443f-a0c9-6b775450a18f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Action: 'create', calling method: .version_select at 0x7ffbf030b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-587742471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhWWMGgpg5HBD4S3qBtiDk/Fc58wwH69+GFq6ofOrW29djDkLeJTjtxPqT/oZWdQIeleWKPghfu5+qdUvW8E+Hn8oErVfnSvZeIfxNfXKhUnSQ051+f4U1C4545gXj7bA=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:14.375607 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-837d7063-33d0-443f-a0c9-6b775450a18f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Getting quotas for project 815e83f886cc4c78bcdc31eb4230c782. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:14:14.380722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-837d7063-33d0-443f-a0c9-6b775450a18f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Getting quotas for user 9966a96281b745e684d0cd16bb470e6a and project 815e83f886cc4c78bcdc31eb4230c782. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:14:14.435100 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-837d7063-33d0-443f-a0c9-6b775450a18f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.544206 Jul 05 10:14:14.435709 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 121/242] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:14:13 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:15.145102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:15.146506 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:15.154871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:15.155327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:15.156105 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:15.156547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:15.532803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:15.547252 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd69a647-3072-4634-a9a2-8c6d657c4c04 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.404484 Jul 05 10:14:15.550734 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 122/243] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:15 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:16.566027 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:16.566702 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:16.578080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:16.579508 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:16.580696 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:16.581129 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:16.833800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:16.877646 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-83fb71eb-9eaa-426b-a702-a4aad751d506 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1502 microversion: 2.1 time: 0.316268 Jul 05 10:14:16.879854 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 122/244] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:16 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1502 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:16.897758 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c242ae3a-813c-4b20-a4d9-fa8161602f2b"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:16.898949 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:16.915196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:16.915856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:16.916807 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:16.918780 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:16.966814 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] HTTP exception thrown: Cannot 'attach_volume' instance 6d51ee6e-4926-463c-82fa-66b06c93c8da while it is in vm_state rescued Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Request method failure captured: Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/os-volume_attachments HTTP/1.1 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 74 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6Nun9DRgjvvp1RovVHa3pWnEaJSrhwN5YnUCPEPtraVs8X__jyqVw9PJK9HMVsfrS7r6WU_LwQL7OG3sPG6fP33KhsffAg-MHEpEKA7bPzEwHHbnPCbXWNCCssljiQx7AvIJVTIHTvNQ4IdKFeaU2H5W_bDXl-sftGusHE7lFkBEQ Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:14:16.968941 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 3c6e5faddabd4208b6e476be4b59e834 Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: {"volumeAttachment": {"volumeId": "c242ae3a-813c-4b20-a4d9-fa8161602f2b"}} Jul 05 10:14:16.970506 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Cannot 'attach_volume' instance 6d51ee6e-4926-463c-82fa-66b06c93c8da while it is in vm_state rescued Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'server_id': '6d51ee6e-4926-463c-82fa-66b06c93c8da', 'body': {'volumeAttachment': {'volumeId': 'c242ae3a-813c-4b20-a4d9-fa8161602f2b'}}} Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:14:16.971375 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6d51ee6e-4926-463c-82fa-66b06c93c8da while it is in vm_state rescued Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:14:16.972597 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:14:16.973879 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:14:16.973879 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:14:16.973879 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6d51ee6e-4926-463c-82fa-66b06c93c8da while it is in vm_state rescued Jul 05 10:14:16.973879 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:14:16.975492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Returning 409 to user: Cannot 'attach_volume' instance 6d51ee6e-4926-463c-82fa-66b06c93c8da while it is in vm_state rescued {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:14:16.976791 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2d80048f-e1fc-49ae-a37b-30f9c18816d0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.084832 Jul 05 10:14:16.981323 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 123/245] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:14:16 2022] POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 10:14:16.988159 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:16.988958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:17.004792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:17.005239 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:17.006009 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:17.006477 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:17.092747 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-675de819-e181-447e-8072-a4a3abbf40ca tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/action" status: 202 len: 0 microversion: 2.1 time: 0.109069 Jul 05 10:14:17.096540 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 123/246] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:14:16 2022] POST /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:14:17.104871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:17.106049 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:17.121849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:17.122934 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:17.125193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:17.125635 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:17.325555 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:17.335545 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e2369c65-2f68-4c20-9ca2-e9483ed50156 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1510 microversion: 2.1 time: 0.237433 Jul 05 10:14:17.336166 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 124/247] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:17 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:18.354594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:18.355904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:18.362632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:18.363267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:18.364029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:18.364647 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:18.510584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:18.524348 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-43da1e6e-908f-4a38-9417-f901be9f08f0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1510 microversion: 2.1 time: 0.174451 Jul 05 10:14:18.524680 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 124/248] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:18 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:19.541001 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:19.541603 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:19.547930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:19.548372 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:19.549229 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:19.549645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:19.715167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:19.724016 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-691cd747-b7fe-4add-9e65-a163ed2f6f7b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1510 microversion: 2.1 time: 0.186750 Jul 05 10:14:19.724523 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 125/249] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:19 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:20.741385 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:20.743556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:20.750314 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:20.751050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:20.752451 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:20.752932 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:20.953390 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:20.975831 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f38ebee-3d41-48ae-ba1e-5a328d01795d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1516 microversion: 2.1 time: 0.238487 Jul 05 10:14:20.980016 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:20 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:22.408580 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-027bf232-4619-4530-98ec-8121dedc0ef8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: .version_select at 0x7ffbf0324430>, body: {"keypair": {"name": "tempest-keypair-76834046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcix+rMm/9541A5U3y3E3fdqTAN0EHc6MSUP4v1CjII1/BmrJOkmqdE87YddzFZ29O1l7e+InT6PqNNuD7lQTMoGYdYuYFhJLqMSQSSk7HgQ3SxuYloAum6L818ZLVACg=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:22.448483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-027bf232-4619-4530-98ec-8121dedc0ef8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for project de80b31cd6c144ac838b613648f8f3a7. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:14:22.463893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-027bf232-4619-4530-98ec-8121dedc0ef8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for user 3c6e5faddabd4208b6e476be4b59e834 and project de80b31cd6c144ac838b613648f8f3a7. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:14:22.512662 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-027bf232-4619-4530-98ec-8121dedc0ef8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.108685 Jul 05 10:14:22.514017 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 126/251] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:14:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:24.044569 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2109364645", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "555e67c4-3856-41b0-a7ee-e5d3fa1cf9af"}], "security_groups": [{"name": "tempest-securitygroup--1505286876"}], "key_name": "tempest-keypair-76834046", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:24.388302 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:30.972477 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:33.560779 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] validate_networks() for [('555e67c4-3856-41b0-a7ee-e5d3fa1cf9af', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:14:33.766420 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:33.959938 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:14:33.960361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:14:33.960831 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:14:33.961219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:14:33.961634 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:14:33.972242 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:33.972696 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:33.973501 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:33.973954 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:34.135518 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:14:34.139789 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Getting quotas for user 3c6e5faddabd4208b6e476be4b59e834 and project de80b31cd6c144ac838b613648f8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:14:34.151997 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:14:34.154345 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:14:34.200829 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-55efda5a-6a46-4dfd-adf5-2094dae8e1b5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 10.160545 Jul 05 10:14:34.201629 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 126/252] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:14:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 10162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:14:34.208964 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=57 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:34.210343 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:34.211101 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:34.215851 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0d992da0-55d5-45c1-970f-b5118d08121f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:34.216447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0d992da0-55d5-45c1-970f-b5118d08121f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:34.277544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0d992da0-55d5-45c1-970f-b5118d08121f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:34.284491 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0d992da0-55d5-45c1-970f-b5118d08121f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1244 microversion: 2.1 time: 0.076484 Jul 05 10:14:34.285010 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 127/253] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:34 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1244 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:35.301475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:35.302268 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:35.309372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:35.309823 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:35.310911 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:35.311394 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:35.388059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:35.398007 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6338b2c5-0a79-4bdf-b81f-44f6f6ce0885 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1304 microversion: 2.1 time: 0.100871 Jul 05 10:14:35.398699 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 127/254] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:35 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:36.417770 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:36.418353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:36.425614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:36.426071 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:36.427086 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:36.427696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:36.567798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:36.576296 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-742cdac4-c4c1-4ad2-a5f0-e581ed908c2c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.163318 Jul 05 10:14:36.576968 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 128/255] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:36 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:36.855962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-5cdf3a50-8385-49ac-99fe-56aeda311dc6 req-35dbf3e1-4dfb-44ef-9482-531033092380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:36.881268 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-5cdf3a50-8385-49ac-99fe-56aeda311dc6 req-35dbf3e1-4dfb-44ef-9482-531033092380 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:36.881715 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-5cdf3a50-8385-49ac-99fe-56aeda311dc6 req-35dbf3e1-4dfb-44ef-9482-531033092380 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:36.899872 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-5cdf3a50-8385-49ac-99fe-56aeda311dc6 req-35dbf3e1-4dfb-44ef-9482-531033092380 service nova] Creating event network-changed:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:14:36.905086 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-5cdf3a50-8385-49ac-99fe-56aeda311dc6 req-35dbf3e1-4dfb-44ef-9482-531033092380 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056292 Jul 05 10:14:36.905841 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 128/256] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:37.593472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:37.594517 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:37.601107 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:37.601545 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:37.602325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:37.602783 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:37.734042 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:37.741809 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-407e459e-20bc-465f-acbb-7e088862990f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.152366 Jul 05 10:14:37.742369 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 129/257] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:37 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:38.764518 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:38.765769 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:38.776552 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:38.777301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:38.778691 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:38.779134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:38.923868 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:38.931560 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6f516215-e096-463d-a1bd-3e50766c0d6d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.174990 Jul 05 10:14:38.932121 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 129/258] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:38 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:39.953696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:39.954672 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:39.966182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:39.966949 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:39.968227 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:39.968893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:40.107539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:40.115512 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6ae364b1-69df-4822-b9df-738eb839ca51 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.168999 Jul 05 10:14:40.116082 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 130/259] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:39 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:41.132872 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:41.133513 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:41.140472 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:41.140919 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:41.141684 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:41.142117 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:41.278952 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:41.286991 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bca59be7-1579-4f4a-9d87-e96ffc988acc tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.158145 Jul 05 10:14:41.287521 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 130/260] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:41 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:42.304848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:42.305450 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:42.312238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:42.312679 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:42.313505 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:42.313924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:42.457942 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:42.473393 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7c3098fb-969c-4b66-924c-37117196a518 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.172751 Jul 05 10:14:42.478266 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 131/261] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:42 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:43.494872 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:43.495840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:43.507083 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:43.507866 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:43.509095 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:43.509820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:43.641475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:43.649152 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-244d926c-83e4-477a-994b-c17fdab25d81 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.160913 Jul 05 10:14:43.649709 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 131/262] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:43 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:43.782610 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-aaadb9b4-3e4e-44f5-88ef-925e9236e8ce req-e3a86aec-83e4-4425-a1d0-79436a1a60ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "name": "network-vif-plugged", "status": "completed", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:43.794479 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-aaadb9b4-3e4e-44f5-88ef-925e9236e8ce req-e3a86aec-83e4-4425-a1d0-79436a1a60ff service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:43.795984 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-aaadb9b4-3e4e-44f5-88ef-925e9236e8ce req-e3a86aec-83e4-4425-a1d0-79436a1a60ff service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:43.808247 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-aaadb9b4-3e4e-44f5-88ef-925e9236e8ce req-e3a86aec-83e4-4425-a1d0-79436a1a60ff service nova] Creating event network-vif-plugged:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:14:43.813845 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-aaadb9b4-3e4e-44f5-88ef-925e9236e8ce req-e3a86aec-83e4-4425-a1d0-79436a1a60ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035080 Jul 05 10:14:43.814801 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 132/263] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:44.666562 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:44.667181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:44.669220 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:44.669908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:44.676518 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:44.676966 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:44.677736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:44.678172 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:44.831351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:44.842492 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8874fca5-7beb-405b-8703-2ca8b9017181 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.180029 Jul 05 10:14:44.843197 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 132/264] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:44 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:45.866208 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:45.867390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:45.870685 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:45.880038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:45.880779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:45.882035 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:45.882799 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:46.028874 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:46.037323 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c3f9f35c-9a32-4fa7-9b34-aea57c04b2ef tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1370 microversion: 2.1 time: 0.178379 Jul 05 10:14:46.038163 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 133/265] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:45 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:47.057692 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:47.058440 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:47.068915 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.069599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.070909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.071567 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.207118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:47.215733 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8a8dea9a-49a8-48fb-b7ee-0890caede714 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1564 microversion: 2.1 time: 0.164533 Jul 05 10:14:47.216305 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 133/266] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:47 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:47.232365 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:47.232941 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:47.239470 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.240008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.240754 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.241258 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.319397 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aaedcc33-9014-4b03-9d50-499037dcf3d6 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091103 Jul 05 10:14:47.320006 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 134/267] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:14:47 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:47.463726 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1332653174", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-587742471", "security_groups": [{"name": "tempest-secgroup-smoke-155083654"}], "networks": [{"uuid": "074290bd-da81-41d9-af71-05900bdaa66b"}], "block_device_mapping_v2": [{"uuid": "51668776-13d9-495c-913f-25107a695372", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:47.573888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] validate_networks() for [('074290bd-da81-41d9-af71-05900bdaa66b', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:14:47.944377 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:14:47.944818 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:14:47.945279 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:14:47.945678 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:14:47.946078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:14:47.956300 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.956738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.957896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:47.958344 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:47.976004 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Getting quotas for project 815e83f886cc4c78bcdc31eb4230c782. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:14:47.980453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Getting quotas for user 9966a96281b745e684d0cd16bb470e6a and project 815e83f886cc4c78bcdc31eb4230c782. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:14:48.040179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:14:48.042267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51668776-13d9-495c-913f-25107a695372',volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:14:48.175550 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4feb83bf-c197-4e01-bf4b-8b3bd8c12b86 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.715684 Jul 05 10:14:48.181754 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 134/268] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:14:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:14:48.187293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e5b65dae-cb2b-41ed-bd02-313d2654de7b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:48.188015 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e5b65dae-cb2b-41ed-bd02-313d2654de7b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:48.244320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e5b65dae-cb2b-41ed-bd02-313d2654de7b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:48.253569 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e5b65dae-cb2b-41ed-bd02-313d2654de7b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1088 microversion: 2.1 time: 0.070680 Jul 05 10:14:48.254186 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 135/269] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:48 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:48.660553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-40f184b5-7b9a-40fb-8e9b-4e9e52fc3e4e req-4a56a419-0383-4a6c-9b34-0a209608e235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:48.668913 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-40f184b5-7b9a-40fb-8e9b-4e9e52fc3e4e req-4a56a419-0383-4a6c-9b34-0a209608e235 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:48.669356 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-40f184b5-7b9a-40fb-8e9b-4e9e52fc3e4e req-4a56a419-0383-4a6c-9b34-0a209608e235 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:48.681795 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-40f184b5-7b9a-40fb-8e9b-4e9e52fc3e4e req-4a56a419-0383-4a6c-9b34-0a209608e235 service nova] Creating event network-changed:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:14:48.686978 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-40f184b5-7b9a-40fb-8e9b-4e9e52fc3e4e req-4a56a419-0383-4a6c-9b34-0a209608e235 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030204 Jul 05 10:14:48.687922 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 135/270] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:49.271809 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:49.272404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:49.278713 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:49.279456 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:49.280147 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:49.280574 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:49.365203 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:49.377307 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e30712c4-7d5b-43aa-a78e-17f152caec1b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1194 microversion: 2.1 time: 0.109691 Jul 05 10:14:49.378115 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 136/271] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:49 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:50.395725 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:50.396720 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:50.404090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:50.404546 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:50.405311 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:50.405746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:50.537029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:50.544961 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-17f88f2f-ab59-4716-83b2-8945154742a7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.153920 Jul 05 10:14:50.545579 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 136/272] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:50 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:14:50.893065 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-53fbc8ec-8296-44ce-b2c9-f625698879f3 req-282cf631-549f-4127-a325-e853d51016c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:50.909362 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-53fbc8ec-8296-44ce-b2c9-f625698879f3 req-282cf631-549f-4127-a325-e853d51016c6 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:50.911336 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-53fbc8ec-8296-44ce-b2c9-f625698879f3 req-282cf631-549f-4127-a325-e853d51016c6 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:50.923287 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-53fbc8ec-8296-44ce-b2c9-f625698879f3 req-282cf631-549f-4127-a325-e853d51016c6 service nova] Creating event network-changed:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:14:50.930459 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-53fbc8ec-8296-44ce-b2c9-f625698879f3 req-282cf631-549f-4127-a325-e853d51016c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045964 Jul 05 10:14:50.931086 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 137/273] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:51.561597 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:51.562247 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:51.569345 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:51.569796 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:51.570594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:51.571031 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:51.703561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:51.712011 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-94ebe56a-f1f6-46ad-a4a1-e3fd397f0f70 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.154459 Jul 05 10:14:51.712623 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:51 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:52.733990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:52.735040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:52.745434 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:52.746163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:52.747451 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:52.748156 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:52.890168 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:52.902054 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-21379e42-dd4f-49a6-a529-7d6b0764b830 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.174931 Jul 05 10:14:52.902889 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:52 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:53.925639 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:53.926292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:53.934444 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:53.934977 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:53.935948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:53.936457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:54.071577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:54.086071 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a374e2cd-48a7-431d-912c-73bd50a5984d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.167020 Jul 05 10:14:54.086716 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 138/276] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:53 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:55.106693 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:55.107663 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:55.119056 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:55.119788 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:55.121084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:55.121754 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:55.255559 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:55.263655 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70e75130-61d0-497d-9c19-842f1dd678d7 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.163429 Jul 05 10:14:55.264229 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 139/277] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:55 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:56.280578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:56.281231 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:56.290280 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:56.290857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:56.291840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:56.292416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:56.430855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:56.438878 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-581491f3-1374-4730-b743-e2aa1aae59f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.162237 Jul 05 10:14:56.439682 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 139/278] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:56 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:57.456178 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:57.456769 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:57.463469 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:57.463904 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:57.464654 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:57.465076 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:57.603945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:57.611839 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9ae9ae5b-c1d0-49c1-ace3-0d7674477722 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.159786 Jul 05 10:14:57.612401 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 140/279] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:57 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:57.809346 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-130cff8c-aa68-489a-b808-d52e307d349e req-5adb8426-a495-49d0-95fe-78e9b02f88e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "name": "network-vif-plugged", "status": "completed", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:14:57.818511 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-130cff8c-aa68-489a-b808-d52e307d349e req-5adb8426-a495-49d0-95fe-78e9b02f88e2 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:57.818947 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-130cff8c-aa68-489a-b808-d52e307d349e req-5adb8426-a495-49d0-95fe-78e9b02f88e2 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:57.830411 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-130cff8c-aa68-489a-b808-d52e307d349e req-5adb8426-a495-49d0-95fe-78e9b02f88e2 service nova] Creating event network-vif-plugged:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:14:57.836167 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-130cff8c-aa68-489a-b808-d52e307d349e req-5adb8426-a495-49d0-95fe-78e9b02f88e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030554 Jul 05 10:14:57.836862 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 140/280] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:14:58.632274 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:58.632842 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:58.635034 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:58.640129 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:58.640593 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:58.641390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:58.641815 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:58.782124 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:58.790502 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-80d212db-d4d0-4570-baf0-70ba98fa2dbc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1259 microversion: 2.1 time: 0.163384 Jul 05 10:14:58.791634 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 141/281] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:58 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:59.807891 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:59.809690 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:14:59.815274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:14:59.816113 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:14:59.823802 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:59.824869 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:59.825867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:14:59.826406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:14:59.971170 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:14:59.980923 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bc2381ea-1c8c-4770-b4f0-f10f63292ca4 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1443 microversion: 2.1 time: 0.177236 Jul 05 10:14:59.981493 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 141/282] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:59 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:14:59.999507 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:00.000127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:00.006724 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:00.007163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:00.007963 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:00.008490 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:00.173738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:00.181815 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b91754f1-99c8-4ccb-8895-ba06b4baf59d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1443 microversion: 2.1 time: 0.186080 Jul 05 10:15:00.182505 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 142/283] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:14:59 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1443 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:15:02.188246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-8823dbee-c974-4daa-9fb2-c0414ad65e63 req-2699ea7f-2301-45a1-af63-7aef414c8589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:02.197355 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8823dbee-c974-4daa-9fb2-c0414ad65e63 req-2699ea7f-2301-45a1-af63-7aef414c8589 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:02.197803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8823dbee-c974-4daa-9fb2-c0414ad65e63 req-2699ea7f-2301-45a1-af63-7aef414c8589 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:02.201859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=77 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:02.210124 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-8823dbee-c974-4daa-9fb2-c0414ad65e63 req-2699ea7f-2301-45a1-af63-7aef414c8589 service nova] Creating event network-changed:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:15:02.215359 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-8823dbee-c974-4daa-9fb2-c0414ad65e63 req-2699ea7f-2301-45a1-af63-7aef414c8589 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030821 Jul 05 10:15:02.216322 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 142/284] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:15:07.022914 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:07.023822 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:07.026738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=37 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:07.035673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:07.036406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:07.037662 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:07.038424 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:07.042630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=75 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:07.063970 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d812829c-3cfe-4e4c-b41e-a4264edf508f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/ips" status: 200 len: 151 microversion: 2.20 time: 0.047668 Jul 05 10:15:07.064541 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 143/285] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jul 5 10:15:07 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/ips => generated 151 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:15:09.095164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:09.096228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:09.099353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:09.107805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:09.108254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:09.109040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:09.109437 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:09.133242 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lazy-loading 'flavor' on Instance uuid 791f0134-8c12-4dfd-a93f-254bdfe7fded {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:15:09.439621 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9967973b-69c4-4521-8dfd-da662725cecc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/action" status: 202 len: 0 microversion: 2.20 time: 0.352685 Jul 05 10:15:09.440306 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 143/286] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 5 10:15:09 2022] POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:15:09.448762 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:09.449431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:09.455510 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:09.455953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:09.456699 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:09.457119 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:09.591179 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:09.599534 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:09.601023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:09.602162 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ce6be238-e1f2-4a84-a62f-a5ed63688e4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.157379 Jul 05 10:15:09.602983 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 144/287] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:09 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:10.632404 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:10.633418 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:10.641895 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:10.642384 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:10.643143 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:10.643573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:10.779182 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:10.787553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:10.789056 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:10.790207 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f9aced45-25fb-43e8-a0bb-246fef7515ac tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.166055 Jul 05 10:15:10.790809 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 144/288] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:10 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:11.810504 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:11.811205 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:11.818039 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:11.818486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:11.819285 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:11.819715 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:11.976040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:11.986589 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:11.988076 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:11.989220 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0576813b-ce71-4e65-94c8-609c0d10f9da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.183055 Jul 05 10:15:11.989770 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 145/289] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:11 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:13.011954 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:13.012975 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:13.024173 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:13.024921 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:13.026174 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:13.026953 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:13.171286 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:13.179627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:13.181217 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:13.182385 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9831ee2d-023d-4966-9d09-113db6cbcc7c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.177046 Jul 05 10:15:13.182982 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 145/290] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:13 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:14.204418 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:14.205245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:14.212329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:14.212764 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:14.213568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:14.213943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:14.349522 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:14.360038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:14.361530 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:14.362944 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a9a47d4c-8de5-4942-82a7-8c41754139ba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.165108 Jul 05 10:15:14.363503 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 146/291] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:14 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:15.391410 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:15.392336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:15.403755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:15.404497 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:15.405761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:15.406516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:15.542275 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:15.552790 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:15.554336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:15.555498 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ef550d8c-ae7c-4d44-bcc3-659f1a4f9293 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.170810 Jul 05 10:15:15.556055 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 146/292] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:15 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:16.574157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:16.574825 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:16.581400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:16.582002 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:16.582813 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:16.583249 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:16.718700 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:16.727561 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:16.729767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:16.730940 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a303b33d-b127-4b33-b2de-54d3b538110a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.160932 Jul 05 10:15:16.731499 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 147/293] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:16 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:17.753013 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:17.754000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:17.764896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:17.766557 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:17.767842 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:17.768568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:17.913759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:17.922255 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:17.923777 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:17.924932 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-eab3995a-560f-4ffa-912d-80284f99a8d1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.178560 Jul 05 10:15:17.925543 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 147/294] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:17 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:18.951462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:18.952413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:18.963238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:18.964114 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:18.965346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:18.966044 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:19.099909 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:19.108207 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:19.109698 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:19.110868 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3cca5b07-8255-4511-bb8c-576d90500668 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.168594 Jul 05 10:15:19.111425 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 148/295] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:18 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:20.133216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:20.134158 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:20.144251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:20.144991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:20.146354 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:20.146815 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:20.281778 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:20.290205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:20.291740 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:20.292894 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3387febd-6d68-4368-b384-ee941945c6da tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.166739 Jul 05 10:15:20.293459 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 148/296] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:20 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:21.316874 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:21.317731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:21.324571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:21.325012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:21.325762 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:21.326191 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:21.465740 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:21.478956 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:21.480533 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:21.481695 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f1383698-925c-46ee-8bf0-a6d6980a0775 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.172673 Jul 05 10:15:21.482286 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 149/297] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:21 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:22.503808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:22.504436 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:22.515138 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:22.515788 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:22.516898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:22.517478 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:22.647098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:22.655188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:22.656707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:22.657860 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-08b4865b-15be-4d7f-9dae-64f9562ac9c1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.160185 Jul 05 10:15:22.658483 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 149/298] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:22 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:23.679943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:23.680565 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:23.687086 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:23.687531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:23.688298 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:23.688726 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:23.819490 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:23.827980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:23.829474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:23.830845 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b260dc5-7a58-41ec-b37e-43fb9fb9e1f9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.156509 Jul 05 10:15:23.831416 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 150/299] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:23 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:24.851862 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:24.852439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:24.859586 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:24.860037 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:24.860800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:24.861234 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:24.996343 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:25.004785 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:25.006288 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:25.007516 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-06927674-32b6-4019-8698-314881d0a8c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.159760 Jul 05 10:15:25.008050 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 150/300] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:24 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:26.029955 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:26.030833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:26.041068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:26.041804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:26.043091 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:26.043792 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:26.187124 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:26.197204 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:26.198828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:26.200002 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5dda4089-2de8-460a-94e3-890018595d67 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.176715 Jul 05 10:15:26.200610 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 151/301] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:26 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:27.223332 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:27.224292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:27.232329 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:27.232781 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:27.233556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:27.233993 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:27.373058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:27.381865 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:27.383555 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:27.384723 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-92e169da-3a41-43d7-bcc2-e2f68161a881 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.168112 Jul 05 10:15:27.385292 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 151/302] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:27 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:28.406634 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:28.407560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:28.417673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:28.418463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:28.419703 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:28.420408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:28.555170 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:28.563252 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:28.564796 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:28.565939 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-08e5bb1e-8dd7-4380-825b-0210b10a2d07 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.165851 Jul 05 10:15:28.566535 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 152/303] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:28 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:29.589200 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:29.590146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:29.601138 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:29.601873 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:29.602682 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:29.603129 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:29.749130 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:29.757541 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:29.759176 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:29.760332 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-77844f21-52f1-4875-a054-f7d13c151847 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.178235 Jul 05 10:15:29.760927 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 152/304] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:29 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:29.998883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-52996b18-7b3a-45bd-8ec6-57459418b4b0 req-11c29bee-eaf8-4d96-81cb-6f7c1d79b612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "name": "network-vif-plugged", "status": "completed", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:30.007767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-52996b18-7b3a-45bd-8ec6-57459418b4b0 req-11c29bee-eaf8-4d96-81cb-6f7c1d79b612 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:30.008119 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-52996b18-7b3a-45bd-8ec6-57459418b4b0 req-11c29bee-eaf8-4d96-81cb-6f7c1d79b612 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:30.020168 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-52996b18-7b3a-45bd-8ec6-57459418b4b0 req-11c29bee-eaf8-4d96-81cb-6f7c1d79b612 service nova] Creating event network-vif-plugged:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:15:30.025205 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-52996b18-7b3a-45bd-8ec6-57459418b4b0 req-11c29bee-eaf8-4d96-81cb-6f7c1d79b612 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 Jul 05 10:15:30.025803 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 153/305] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:15:30.783022 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:30.784000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:30.793456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:30.793894 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:30.794688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:30.795116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:30.924089 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:30.932502 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:30.933998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:30.935205 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-44563b4b-845a-485b-bbf6-2b4ceda11918 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.158848 Jul 05 10:15:30.935729 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 153/306] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:30 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:31.963299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:31.964389 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:31.974987 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:31.975698 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:31.976945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:31.977656 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:32.119472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:32.127837 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:32.129339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:32.130517 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e2ebeadb-0ab4-400e-83fd-713ae0d81b60 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.175111 Jul 05 10:15:32.131119 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 154/307] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:31 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:33.158645 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:33.159615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:33.171470 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:33.171922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:33.172682 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:33.173111 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:33.175829 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:33.306731 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:33.315717 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:33.317234 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:33.318465 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b3ee51aa-a846-4bdd-ba4d-3604dae01c87 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1745 microversion: 2.20 time: 0.166491 Jul 05 10:15:33.319026 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 154/308] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:33 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:34.340185 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:34.341020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:34.347652 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:34.348109 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:34.348857 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:34.349284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:34.484775 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:34.492926 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:34.494461 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:34.495637 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-97213237-4874-40f4-b9e1-7f11a258fa91 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.159810 Jul 05 10:15:34.496187 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 155/309] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:34 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:35.514868 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:35.516221 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:35.523486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:35.524221 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:35.525186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:35.525618 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:35.664075 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:35.672539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:35.674060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:35.675279 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-097ca78c-f406-4cb8-822b-3d101481a2c0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.164693 Jul 05 10:15:35.675853 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 155/310] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:35 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:36.693183 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:36.693777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:36.702038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:36.702816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:36.703924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:36.704437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:36.843293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:36.851445 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:36.852928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:36.854083 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-41127d2d-258e-4005-b69e-031cac497478 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.164918 Jul 05 10:15:36.854663 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 156/311] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:36 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:37.872886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:37.873534 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:37.882412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:37.882794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:37.883664 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:37.883990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:38.041922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:38.051396 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:38.053182 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:38.054699 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-09068635-2c40-4823-b20f-13063adeddcf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.186152 Jul 05 10:15:38.055243 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 156/312] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:37 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:39.073274 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:39.074074 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:39.076467 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=28 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:39.082116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:39.082872 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:39.083699 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:39.084244 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:39.087259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=78 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:39.218376 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:39.227232 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:39.229144 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:39.230988 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f011a827-dd8c-4800-aa5e-f1ba21536b16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.161808 Jul 05 10:15:39.231960 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 157/313] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:39 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:40.251557 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:40.252963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:40.255464 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=28 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:15:40.261522 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:40.261963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:40.262816 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:40.263254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:40.424755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:40.436600 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:40.439968 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:40.441777 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-914b83e7-e106-46cd-a66b-58598a079553 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.194265 Jul 05 10:15:40.442366 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 157/314] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:40 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:41.466427 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:41.466427 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:41.471406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:41.471856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:41.472648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:41.473071 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:41.650404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:41.659068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:41.660574 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:41.661993 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-38c8dccc-8f2c-4736-9498-b22641b0f113 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.203755 Jul 05 10:15:41.663245 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 158/315] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:41 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:42.680900 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:42.688463 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:42.695538 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:42.696167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:42.696845 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:42.697312 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:42.848808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:42.864133 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:42.865874 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:42.867109 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e7c0ceae-579a-44fa-aba9-0efe90360e09 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.190313 Jul 05 10:15:42.867871 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 158/316] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:42 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:43.885139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:43.885893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:43.894557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:43.895017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:43.895804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:43.896375 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:44.347711 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:44.356108 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:44.357614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:44.358976 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-41ecbab6-cdb4-4d0b-a2da-8b74360397a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.477778 Jul 05 10:15:44.359526 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 159/317] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:43 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:45.377689 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:45.378348 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:45.385750 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:45.386291 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:45.387388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:45.387826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:45.525529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:45.534009 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:45.535553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:45.536702 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a4535f60-097b-414f-b60d-1745946cc2ab tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1740 microversion: 2.20 time: 0.163223 Jul 05 10:15:45.537256 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 159/318] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:45 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:46.555025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:46.555744 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:46.562113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:46.562604 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:46.563370 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:46.563803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:46.697270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:46.707033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:46.708516 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:46.709722 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-09544b62-0b05-412d-af15-d0de6041a2fa tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1722 microversion: 2.20 time: 0.158862 Jul 05 10:15:46.710862 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 160/319] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:46 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:15:47.732583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:47.733615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:47.744927 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:47.745668 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:47.746992 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:47.747710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:47.884214 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:47.892935 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:47.894499 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:47.895663 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-23d2722e-2d5a-4c12-a5fe-4d5be84f8e71 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1722 microversion: 2.20 time: 0.169823 Jul 05 10:15:47.896232 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 160/320] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:47 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:48.922924 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:48.923557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:48.932642 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:48.933138 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:48.934184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:48.934770 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:49.065876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:49.074381 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:49.075881 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:49.077026 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e7e1478d-f481-468f-9e79-eff350004757 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1725 microversion: 2.20 time: 0.160313 Jul 05 10:15:49.077588 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 161/321] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:48 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:49.095839 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10052bb3-5054-48b7-898f-0f70d627050e"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:49.096955 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:49.103390 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:49.103869 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:49.104632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:49.105082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:49.410867 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4921d20e-d52c-4718-b3be-fd7e4956a56f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319297 Jul 05 10:15:49.411510 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 161/322] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jul 5 10:15:49 2022] POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:15:49.536507 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:49.537666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:49.547000 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:49.547434 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:49.548523 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:49.548986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:49.642945 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [2cc981bc-9b43-4f3f-99f4-1b0c70f1cb7e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 10:15:50.054014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-0304c192-f72d-4fdc-8d18-d44325723c38 req-3c064118-f153-4edb-bfc1-cebdbf0a93aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "name": "network-vif-unplugged", "status": "completed", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:50.063157 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0304c192-f72d-4fdc-8d18-d44325723c38 req-3c064118-f153-4edb-bfc1-cebdbf0a93aa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:50.063583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0304c192-f72d-4fdc-8d18-d44325723c38 req-3c064118-f153-4edb-bfc1-cebdbf0a93aa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:50.074440 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.compute.server_external_events [req-0304c192-f72d-4fdc-8d18-d44325723c38 req-3c064118-f153-4edb-bfc1-cebdbf0a93aa service nova] Unable to find a host for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded. Dropping event network-vif-unplugged {{(pid=117865) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 10:15:50.075303 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-0304c192-f72d-4fdc-8d18-d44325723c38 req-3c064118-f153-4edb-bfc1-cebdbf0a93aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025226 Jul 05 10:15:50.075893 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 162/323] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 10:15:50.651439 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [2cc981bc-9b43-4f3f-99f4-1b0c70f1cb7e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35528. Jul 05 10:15:50.655614 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6791a6e6-4f40-467b-b38b-52303d26de4b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/action" status: 202 len: 0 microversion: 2.20 time: 1.125791 Jul 05 10:15:50.656323 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 162/324] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 5 10:15:49 2022] POST /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:15:50.665414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:50.666371 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:50.673520 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:50.674266 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:50.675067 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:50.675500 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:50.805471 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:50.813889 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:50.815419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:50.816561 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0a0654a6-0ed2-4951-8f0d-56bf15045f12 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1751 microversion: 2.20 time: 0.155607 Jul 05 10:15:50.817126 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 163/325] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:50 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:51.834426 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:51.835057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:51.841967 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:51.842446 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:51.843203 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:51.843627 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:51.968764 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:51.977651 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:51.979197 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:51.980367 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c162163-467b-4b3d-a17d-5050fb733306 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1753 microversion: 2.20 time: 0.150041 Jul 05 10:15:51.980968 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 163/326] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:51 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:52.998738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:52.999336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:53.006559 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:53.007001 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:53.007767 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:53.008169 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:53.139925 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:53.148769 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:53.150308 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:53.151486 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-290a3eba-b51e-426b-b746-3f3a9e1823ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.156746 Jul 05 10:15:53.152112 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 164/327] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:52 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:54.170383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:54.170987 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:54.177847 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:54.178326 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:54.179098 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:54.179530 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:54.318539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:54.327437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:54.328947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:54.330158 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-14a6f769-305e-49c4-b3a0-32f1d81e8d79 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.163852 Jul 05 10:15:54.330750 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 164/328] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:54 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:55.020368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:55.021167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:55.028337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:55.028866 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:55.029710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:55.030209 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:55.057543 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-77b0aa20-24d8-4610-8a0e-1ac66bb6c0fb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/ips" status: 200 len: 150 microversion: 2.1 time: 0.040919 Jul 05 10:15:55.058170 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 165/329] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:15:55 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:15:55.353518 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:55.354763 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:55.362209 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:55.362855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:55.363871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:55.364559 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:55.508496 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:55.517971 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:55.519943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:55.521451 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3877a385-fc94-4bf8-8234-4750a08a79e0 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.176094 Jul 05 10:15:55.522674 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 165/330] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:55 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:56.438614 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d236c54-beec-4e55-a230-7e6097b25255"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:15:56.439769 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:56.447110 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:56.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:56.448322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:56.448769 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:56.540557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:56.541166 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:56.549040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:56.549485 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:56.550275 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:56.550889 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:56.699547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:56.709931 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:56.712560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:56.714148 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-26f27b29-5bf6-4036-97bb-caef9aa1379d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.177781 Jul 05 10:15:56.715836 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 166/331] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:56 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:57.734378 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:57.735131 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:57.741922 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:57.742667 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:57.743642 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:57.744218 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:57.901632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:57.912444 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:57.914451 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:57.916102 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-abdd5a53-0ef0-483c-9c7e-830d597ffae9 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.185628 Jul 05 10:15:57.917356 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 167/332] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:57 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:15:58.936232 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:15:58.936996 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:15:58.943876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:58.944398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:58.945168 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:15:58.945606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:15:59.101470 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:59.110770 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:59.112284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:15:59.113458 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-20f5b823-b611-4bb9-8124-c75202997274 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.181285 Jul 05 10:15:59.114037 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 168/333] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:15:58 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:00.134083 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:00.135749 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:00.142729 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:00.143173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:00.143970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:00.144420 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:00.281207 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:00.294068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:00.295843 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:00.297506 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2d5df8c3-80d0-4bc8-9bf6-b7a896f45a65 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.168525 Jul 05 10:16:00.298064 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 169/334] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:00 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:16:01.324356 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:01.325201 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:01.331571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:01.332014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:01.332771 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:01.333199 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:01.473478 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:01.483243 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:01.484745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:01.485923 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1700c137-98f5-4b85-9df3-ea9592bf164f tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.165704 Jul 05 10:16:01.486711 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 170/335] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:01 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:02.508121 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:02.510177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:02.517847 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:02.518377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:02.519148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:02.519576 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:02.656949 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:02.665983 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:02.667580 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:02.670864 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a4ed4c61-7eae-4ccb-b397-ca3833ffb305 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.167509 Jul 05 10:16:02.674382 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 171/336] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:02 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:16:03.687663 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:03.688358 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:03.695010 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:03.695539 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:03.696389 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:03.696912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:03.848994 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:03.851730 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:03.859718 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:03.861226 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:03.862419 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d5077b14-ec34-424a-8a1a-631c8c29906e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.178862 Jul 05 10:16:03.862965 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 172/337] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:03 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:04.885154 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:04.886154 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:04.897973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:04.898785 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:04.900040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:04.900779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:05.040847 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:05.049487 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:05.051053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:05.052210 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-365e6006-f580-4edb-a94e-07fc1e936e0a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.173879 Jul 05 10:16:05.052764 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 173/338] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:04 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:06.072975 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:06.073652 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:06.080200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:06.080649 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:06.081419 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:06.081852 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:06.215732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:06.224419 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:06.226018 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:06.227211 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d24a2db1-06fc-4ca4-a751-d56548af4b5b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.158836 Jul 05 10:16:06.227737 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 174/339] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:06 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:06.445286 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=19 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:06.526927 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:07.247915 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:07.248687 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:07.257037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:07.257619 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:07.258660 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:07.259226 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:07.397096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:07.407063 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:07.408900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:07.410083 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2fa9835c-de04-42c3-811b-1b4bec624968 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.167480 Jul 05 10:16:07.410644 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 175/340] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:07 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:08.432690 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:08.433748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:08.443824 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:08.444613 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:08.445844 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:08.446637 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:08.596801 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:08.608012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:08.609494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:08.610691 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-895ef9c4-068b-407d-91b2-c7d197a34062 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.184570 Jul 05 10:16:08.611239 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 176/341] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:08 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:09.634126 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:09.635320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:09.638077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=42 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:09.646943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:09.647672 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:09.648907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:09.649611 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:09.793517 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:09.806206 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:09.808526 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:09.810265 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-01980571-059b-415d-a960-8104decb7f54 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.182580 Jul 05 10:16:09.811026 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 177/342] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:09 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:10.658460 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-21b29fbe-d075-42f8-aa7e-31af10eab55e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.224754 Jul 05 10:16:10.659425 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 166/343] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:15:56 2022] POST /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments => generated 194 bytes in 14227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:10.828735 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:10.829339 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:10.835737 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:10.836549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:10.837344 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:10.837812 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:10.968488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:10.977020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:10.978557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:10.979709 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5eb114fc-c2c3-4c75-aec6-11e547dbe241 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.154906 Jul 05 10:16:10.980300 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 178/344] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:10 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:12.000194 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:12.000857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:12.007635 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:12.008080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:12.008854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:12.009402 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:12.143398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:12.152001 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:12.153521 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:12.154712 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0833ad6e-3af1-4c49-babc-f225e6fda5b8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.159368 Jul 05 10:16:12.155275 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 167/345] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:11 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:12.214951 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9b014125-26d7-4955-90d9-7d7181684347 req-2b66e0aa-de3b-4b55-bd34-a7c8858b1403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "name": "network-vif-plugged", "status": "completed", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:12.223449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9b014125-26d7-4955-90d9-7d7181684347 req-2b66e0aa-de3b-4b55-bd34-a7c8858b1403 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:12.223883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9b014125-26d7-4955-90d9-7d7181684347 req-2b66e0aa-de3b-4b55-bd34-a7c8858b1403 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:12.235491 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9b014125-26d7-4955-90d9-7d7181684347 req-2b66e0aa-de3b-4b55-bd34-a7c8858b1403 service nova] Creating event network-vif-plugged:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:16:12.240673 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9b014125-26d7-4955-90d9-7d7181684347 req-2b66e0aa-de3b-4b55-bd34-a7c8858b1403 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029731 Jul 05 10:16:12.241273 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 179/346] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:13.176701 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:13.177334 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:13.185734 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:13.186186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:13.186975 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:13.187406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:13.333598 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:13.343724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:13.345223 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:13.346391 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cf0abfd4-50b2-4042-a995-0fbb7366ceba tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.175992 Jul 05 10:16:13.346954 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 168/347] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:13 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:13.966531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f3353594-d7b1-418f-8b61-855ddb852344 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: .version_select at 0x7ffbf0419f70>, body: {"keypair": {"name": "tempest-keypair-736414556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxM48ysfjfsDMMgZCaz89h3pBP20e0jr3Yb/uzPup9vje49k3j/nnGjcaaweut5YMz7NwwuxLvhOgaYbeUJZ/pl+HQl6ZTUD21IJdKV9Ow/Wg4ATqGKlNxtzsjFBsBgMw=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:13.981678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-f3353594-d7b1-418f-8b61-855ddb852344 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:16:13.986094 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-f3353594-d7b1-418f-8b61-855ddb852344 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:16:14.011694 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f3353594-d7b1-418f-8b61-855ddb852344 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050105 Jul 05 10:16:14.012323 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 180/348] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:16:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:14.364907 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:14.365490 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:14.371825 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:14.372241 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:14.372986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:14.373407 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:14.590075 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:14.600777 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:14.603240 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:14.604417 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3abc7c80-d244-4a2c-bc3d-790be5e0c1b3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.243534 Jul 05 10:16:14.605022 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 169/349] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:14 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:15.409850 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-105456680", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98b9981-e889-405e-93b5-a13b417620de"}], "security_groups": [{"name": "tempest-securitygroup--305929870"}], "key_name": "tempest-keypair-736414556", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:15.517127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] validate_networks() for [('c98b9981-e889-405e-93b5-a13b417620de', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:16:15.624665 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:15.625909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:15.634069 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:15.634635 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:15.635540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:15.636059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:15.861746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:15.871282 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:15.872906 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:15.874090 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-05980a3b-174f-43c6-8445-21a5029cb3ad tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1809 microversion: 2.20 time: 0.254540 Jul 05 10:16:15.874943 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 170/350] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:15 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:15.981287 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:16:15.981714 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:16:15.982190 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:16:15.982615 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:16:15.983020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:16:15.992837 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:15.993283 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:15.994107 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:15.994562 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:16.012347 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:16:16.016778 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:16:16.028217 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:16:16.030591 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:16:16.081477 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d933429f-a15c-4952-9b96-2b6e0c045ca8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.675988 Jul 05 10:16:16.082133 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 181/351] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:16:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:16:16.092753 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1a13ca4c-9eaf-4abe-9438-b01a4ac0aaf0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:16.093376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1a13ca4c-9eaf-4abe-9438-b01a4ac0aaf0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:16.147651 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1a13ca4c-9eaf-4abe-9438-b01a4ac0aaf0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:16.155545 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1a13ca4c-9eaf-4abe-9438-b01a4ac0aaf0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1240 microversion: 2.1 time: 0.066650 Jul 05 10:16:16.156086 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 171/352] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:16 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:16.893600 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:16.894191 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:16.901648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:16.902088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:16.902877 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:16.903305 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:17.049726 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:17.060731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:17.062251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:17.063431 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a357b360-fb77-4043-920b-580fc1b635ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1796 microversion: 2.20 time: 0.174227 Jul 05 10:16:17.063986 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 182/353] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:16:16 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1796 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:16:17.172493 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:17.173096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:17.182937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:17.183387 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:17.184179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:17.184615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:17.249400 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:17.258512 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1fa12528-9092-411b-ace2-f5374a6a43ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1300 microversion: 2.1 time: 0.089991 Jul 05 10:16:17.268191 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 172/354] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:17 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:18.277113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:18.277696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:18.285005 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:18.285482 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:18.286268 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:18.286720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:18.413628 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:18.422420 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-96692b01-bcac-4aea-b997-3eac0f2dffc9 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.149924 Jul 05 10:16:18.422972 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 183/355] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:18 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:18.445652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d794d8ef-0753-47ec-ab72-341a55849ffe"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:18.446936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:18.454136 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:18.454735 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:18.455652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:18.456197 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:18.741208 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8897cca8-6b8a-4754-86ca-088736d684d5 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299428 Jul 05 10:16:18.742117 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 173/356] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:16:18 2022] POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:16:18.956468 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-0b466099-28d6-4fe3-b1c5-4b8a85359384 req-299446f0-affd-4ff1-b8bc-234c6016e3ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056f41b2-532d-4fd1-8892-10ef1c06cfb4", "tag": "ff357201-1c14-46dd-afe9-da456b9b848f"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:18.969849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0b466099-28d6-4fe3-b1c5-4b8a85359384 req-299446f0-affd-4ff1-b8bc-234c6016e3ec service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:18.970560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0b466099-28d6-4fe3-b1c5-4b8a85359384 req-299446f0-affd-4ff1-b8bc-234c6016e3ec service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:18.989447 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-0b466099-28d6-4fe3-b1c5-4b8a85359384 req-299446f0-affd-4ff1-b8bc-234c6016e3ec service nova] Creating event network-changed:ff357201-1c14-46dd-afe9-da456b9b848f for instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 on hv-cinder-maste Jul 05 10:16:18.995959 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-0b466099-28d6-4fe3-b1c5-4b8a85359384 req-299446f0-affd-4ff1-b8bc-234c6016e3ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046632 Jul 05 10:16:18.996879 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 184/357] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:19.445391 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:19.446424 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:19.456519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:19.457265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:19.458557 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:19.459272 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:19.593305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:19.601361 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5638b996-cca1-49ed-819e-d8712dcd589a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.163953 Jul 05 10:16:19.601933 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 174/358] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:19 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:20.623631 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:20.624312 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:20.631451 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:20.631998 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:20.632755 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:20.633182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:20.775623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:20.783622 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1a24c0db-055f-4946-932d-75697a7765f5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.167513 Jul 05 10:16:20.784199 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 185/359] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:20 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:21.010562 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:21.011572 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:21.018428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.018874 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.019627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.020082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.042877 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'flavor' on Instance uuid 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:16:21.182712 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a93969ea-f570-4437-ad99-7abc9f3f1919 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/action" status: 200 len: 32 microversion: 2.1 time: 0.175628 Jul 05 10:16:21.183503 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 175/360] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:16:21 2022] POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:16:21.197490 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:21.198398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:21.204614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.205042 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.205798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.206244 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.337945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:21.347132 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-553f96d8-c4e7-4cf3-b1fa-23a82e28358a tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.155568 Jul 05 10:16:21.347895 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 186/361] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:21 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:21.801491 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:21.802190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:21.809147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.809629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.810425 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:21.810859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:21.941661 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:21.949795 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-75b248aa-6262-4204-ab7e-23399a1947bd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.153144 Jul 05 10:16:21.950569 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 176/362] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:21 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:22.367471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:22.368013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:22.375341 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:22.375789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:22.376550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:22.376940 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:22.524354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:22.532660 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4d811d56-8201-4999-bdf9-4a158f36dfdf tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.171534 Jul 05 10:16:22.533229 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 187/363] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:22 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:22.967589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:22.969130 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:22.976534 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:22.977256 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:22.978466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:22.978922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:23.111857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:23.119390 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f10d6707-c48f-4890-a011-1ae8ce6ee728 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.156579 Jul 05 10:16:23.120091 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 177/364] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:22 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:23.553415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:23.554486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:23.563878 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:23.564576 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:23.566004 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:23.566688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:23.699779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:23.707862 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bbbe5310-c79b-408d-b11e-2353969bb501 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.160996 Jul 05 10:16:23.708437 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 188/365] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:23 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:24.141560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:24.142165 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:24.149255 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:24.149708 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:24.150535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:24.150951 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:24.288492 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-ed0f2345-a29d-4ecb-b516-a3e533ace9dd req-1e45e6ac-f318-478e-a401-f8449fdfaf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056f41b2-532d-4fd1-8892-10ef1c06cfb4", "name": "network-vif-plugged", "status": "completed", "tag": "ff357201-1c14-46dd-afe9-da456b9b848f"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:24.295028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:24.298327 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ed0f2345-a29d-4ecb-b516-a3e533ace9dd req-1e45e6ac-f318-478e-a401-f8449fdfaf3b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:24.298761 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ed0f2345-a29d-4ecb-b516-a3e533ace9dd req-1e45e6ac-f318-478e-a401-f8449fdfaf3b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:24.306782 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-73838e6e-302e-4623-a9d6-2c9d209917ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.169112 Jul 05 10:16:24.307404 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 178/366] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:24 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:24.317357 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-ed0f2345-a29d-4ecb-b516-a3e533ace9dd req-1e45e6ac-f318-478e-a401-f8449fdfaf3b service nova] Creating event network-vif-plugged:ff357201-1c14-46dd-afe9-da456b9b848f for instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 on hv-cinder-maste Jul 05 10:16:24.322429 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-ed0f2345-a29d-4ecb-b516-a3e533ace9dd req-1e45e6ac-f318-478e-a401-f8449fdfaf3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038952 Jul 05 10:16:24.323172 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 189/367] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:24.727513 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:24.728479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:24.735574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:24.736019 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:24.736776 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:24.737205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:24.865774 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:24.869460 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:24.874807 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f8a9f330-c672-4855-811a-18571a8485c4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.153449 Jul 05 10:16:24.875420 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 179/368] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:24 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:25.329443 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:25.330885 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:25.340752 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:25.341193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:25.342110 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:25.342718 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:25.475202 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:25.487009 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5deb5bd5-da94-46ff-a5bb-009a4fba7eaa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1365 microversion: 2.1 time: 0.165038 Jul 05 10:16:25.487762 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 190/369] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:25 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:25.895844 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:25.896468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:25.905786 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:25.906266 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:25.907150 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:25.907596 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:26.038107 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:26.046615 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0c652107-f383-435f-8291-6b2515c998f9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.157094 Jul 05 10:16:26.047202 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 180/370] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:25 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:26.512354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:26.513301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:26.515526 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:26.516276 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:26.523026 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:26.523535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:26.524357 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:26.524836 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:26.658266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:26.666483 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9584c684-f6e8-4013-8b87-b47fe83cfc92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1555 microversion: 2.1 time: 0.160593 Jul 05 10:16:26.667070 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 191/371] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:26 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:26.683295 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:26.683797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:26.685751 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:26.691333 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:26.691785 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:26.692545 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:26.692974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:26.779875 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3756277f-232a-4f56-8933-0fd0d8c6acc5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100487 Jul 05 10:16:26.780495 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 181/372] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:16:26 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:27.064343 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:27.065048 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:27.072046 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:27.073044 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:27.073824 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:27.074260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:27.282811 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:27.292658 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74a92eea-12a5-4ed5-a95a-8d3af3c412c0 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.232159 Jul 05 10:16:27.293448 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 192/373] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:27 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:28.046671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-935272c2-337b-4abc-8af7-6810a04347b3 req-3580bd69-a29d-4af6-80b6-92268e57496c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "056f41b2-532d-4fd1-8892-10ef1c06cfb4", "tag": "ff357201-1c14-46dd-afe9-da456b9b848f"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:28.055250 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-935272c2-337b-4abc-8af7-6810a04347b3 req-3580bd69-a29d-4af6-80b6-92268e57496c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:28.055696 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-935272c2-337b-4abc-8af7-6810a04347b3 req-3580bd69-a29d-4af6-80b6-92268e57496c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:28.066928 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-935272c2-337b-4abc-8af7-6810a04347b3 req-3580bd69-a29d-4af6-80b6-92268e57496c service nova] Creating event network-changed:ff357201-1c14-46dd-afe9-da456b9b848f for instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 on hv-cinder-maste Jul 05 10:16:28.072011 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-935272c2-337b-4abc-8af7-6810a04347b3 req-3580bd69-a29d-4af6-80b6-92268e57496c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029826 Jul 05 10:16:28.072595 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 182/374] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:28.311701 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:28.312307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:28.318413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:28.318890 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:28.319645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:28.320075 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:28.322652 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=100 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:28.454833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:28.463698 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8797ea0b-d5bd-4663-b3e5-6459e99ff1e4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.156115 Jul 05 10:16:28.464911 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 193/375] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:28 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:29.487368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:29.488384 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:29.499048 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:29.499795 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:29.501051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:29.501775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:29.641216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:29.649267 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2c4cb731-1a2f-4043-9521-ec6ebe4973eb tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.170053 Jul 05 10:16:29.649836 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 183/376] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:29 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:30.670261 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:30.670856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:30.677452 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:30.677893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:30.678810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:30.679238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:30.818774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:30.829072 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2724d31a-2bc7-4528-8056-603bbb7d3db9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.164898 Jul 05 10:16:30.829634 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 194/377] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:30 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:31.851607 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:31.852574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:31.863656 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:31.864426 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:31.865691 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:31.866462 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:32.017136 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:32.029064 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4b366b2b-4fb3-465c-9fd9-ba22f3cdf65b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.184021 Jul 05 10:16:32.029637 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 184/378] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:31 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:33.052614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:33.053331 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:33.061304 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:33.061861 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:33.062855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:33.063390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:33.206325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:33.215045 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-220d2243-92e3-4a26-898d-907f3b6313ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.167295 Jul 05 10:16:33.215618 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 195/379] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:33 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:34.236439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:34.237356 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:34.248443 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:34.248888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:34.249680 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:34.250134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:34.392171 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:34.400963 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4c4f57b-367d-480c-8334-48215832ca38 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.170851 Jul 05 10:16:34.401576 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 185/380] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:34 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:35.423519 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:35.424214 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:35.432546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:35.433111 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:35.434111 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:35.434718 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:35.575569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:35.588455 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-33919e77-9e04-42d0-b6d0-b06e9afed61e tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.170690 Jul 05 10:16:35.589218 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 196/381] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:35 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:36.610029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:36.611055 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:36.614905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=41 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:36.623584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:36.624028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:36.624788 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:36.625212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:36.762810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:36.770981 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c0e77d1c-98e5-46e9-9da7-4a57ce556d5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.167485 Jul 05 10:16:36.771542 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 186/382] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:36 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:37.792486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:37.793465 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:37.804208 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:37.804898 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:37.806178 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:37.806927 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:37.948828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:37.957627 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d39ed9e7-bed8-4be0-a7c5-053aa5744a30 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1734 microversion: 2.1 time: 0.171739 Jul 05 10:16:37.958274 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 197/383] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:37 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:38.979225 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:38.980213 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:38.988246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:38.988704 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:38.989464 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:38.989900 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.131143 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:39.139494 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-74921706-c979-478c-84cd-be771274c668 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1714 microversion: 2.1 time: 0.166857 Jul 05 10:16:39.140084 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 187/384] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:38 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:39.249676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:39.250198 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:39.256601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.257037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.257793 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.258246 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.389306 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] HTTP exception thrown: Cannot 'detach_volume' instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 while it is in vm_state rescued Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Request method failure captured: Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments/d794d8ef-0753-47ec-ab72-341a55849ffe HTTP/1.1 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6Nun9DRgjvvp1RovVHa3pWnEaJSrhwN5YnUCPEPtraVs8X__jyqVw9PJK9HMVsfrS7r6WU_LwQL7OG3sPG6fP33KhsffAg-MHEpEKA7bPzEwHHbnPCbXWNCCssljiQx7AvIJVTIHTvNQ4IdKFeaU2H5W_bDXl-sftGusHE7lFkBEQ Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:16:39.391977 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 3c6e5faddabd4208b6e476be4b59e834 Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:16:39.393426 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Cannot 'detach_volume' instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 while it is in vm_state rescued Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'server_id': '22ee6f64-34a9-4c14-b5d8-aafbcc4913a5', 'id': 'd794d8ef-0753-47ec-ab72-341a55849ffe'} Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:16:39.394170 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 while it is in vm_state rescued Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 while it is in vm_state rescued Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:16:39.395670 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Returning 409 to user: Cannot 'detach_volume' instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 while it is in vm_state rescued {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:16:39.396889 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-91bec39d-af0b-4ac4-857b-7c53c564974d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments/d794d8ef-0753-47ec-ab72-341a55849ffe" status: 409 len: 152 microversion: 2.1 time: 0.149824 Jul 05 10:16:39.396889 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 198/385] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:16:39 2022] DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments/d794d8ef-0753-47ec-ab72-341a55849ffe => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 05 10:16:39.402682 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:39.403208 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:39.409734 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.410173 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.410957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.411381 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.483406 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2c65ad1c-6ff4-4d1f-bd60-bf064207c8e9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/action" status: 202 len: 0 microversion: 2.1 time: 0.084503 Jul 05 10:16:39.484068 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 188/386] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:16:39 2022] POST /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:16:39.492418 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:39.493114 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:39.500097 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.500544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.501313 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:39.501776 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:39.631388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:39.639631 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-54e831ec-c6f6-41c1-898f-59681913ad72 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1722 microversion: 2.1 time: 0.151222 Jul 05 10:16:39.640202 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 199/387] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:39 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:40.663309 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:40.664466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:40.673451 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:40.673898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:40.674697 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:40.675182 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:40.820551 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:40.834029 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8bf6d3e0-e84b-4fc5-b34b-0959d991bdb4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1722 microversion: 2.1 time: 0.178494 Jul 05 10:16:40.834995 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 189/388] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:40 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:41.857754 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:41.858935 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:41.861889 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:16:41.870826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:41.871562 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:41.872894 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:41.873665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:42.009727 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:42.018259 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c6ac153c-ac98-42ea-9bbc-a7c9d0ed001d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1722 microversion: 2.1 time: 0.168110 Jul 05 10:16:42.018834 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 200/389] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:41 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:43.039495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:43.040463 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:43.051614 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:43.052439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:43.053874 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:43.054774 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:43.193803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:43.201965 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-686f80e1-7558-4cb4-8206-0458df58f893 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1722 microversion: 2.1 time: 0.168959 Jul 05 10:16:43.202813 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 190/390] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:43 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:44.220436 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:44.221025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:44.228238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:44.228676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:44.229441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:44.229863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:44.363128 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:16:44.373593 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-52d2825c-7f24-4e04-8f2c-9fdfcfa48fed tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1728 microversion: 2.1 time: 0.157127 Jul 05 10:16:44.374196 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 201/391] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:16:44 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:16:44.396421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:16:44.396974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:16:44.403951 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:44.404441 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:44.405224 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:44.405656 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:44.484634 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-85b1dcab-73fd-4dee-a914-7db237c271b9 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091810 Jul 05 10:16:44.485457 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 191/392] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:16:44 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:45.372723 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-8303d94a-4637-4314-8435-0fcef6d13eb9 req-f36f0d8b-f5b1-48fb-9466-8bbb27a49379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:45.381531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8303d94a-4637-4314-8435-0fcef6d13eb9 req-f36f0d8b-f5b1-48fb-9466-8bbb27a49379 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:45.382029 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8303d94a-4637-4314-8435-0fcef6d13eb9 req-f36f0d8b-f5b1-48fb-9466-8bbb27a49379 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:45.395002 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-8303d94a-4637-4314-8435-0fcef6d13eb9 req-f36f0d8b-f5b1-48fb-9466-8bbb27a49379 service nova] Creating event network-changed:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:16:45.401887 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-8303d94a-4637-4314-8435-0fcef6d13eb9 req-f36f0d8b-f5b1-48fb-9466-8bbb27a49379 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032888 Jul 05 10:16:45.402616 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 202/393] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:16:47.423913 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-fa391720-c5cb-4707-b24d-907999932cc9 req-9e2ee1a3-a753-403b-887f-61d4cd0ec7ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:16:47.434419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fa391720-c5cb-4707-b24d-907999932cc9 req-9e2ee1a3-a753-403b-887f-61d4cd0ec7ac service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:16:47.435170 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fa391720-c5cb-4707-b24d-907999932cc9 req-9e2ee1a3-a753-403b-887f-61d4cd0ec7ac service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:16:47.450355 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-fa391720-c5cb-4707-b24d-907999932cc9 req-9e2ee1a3-a753-403b-887f-61d4cd0ec7ac service nova] Creating event network-changed:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:16:47.455864 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-fa391720-c5cb-4707-b24d-907999932cc9 req-9e2ee1a3-a753-403b-887f-61d4cd0ec7ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039477 Jul 05 10:16:47.456437 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 192/394] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:21.848432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=5 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:21.849247 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=55 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:21.853650 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:21.854340 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:21.861507 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:21.861979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:21.862736 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:21.863145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:21.893598 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-957d32bc-d84f-4df4-a12e-f42a38d94c64 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments/10052bb3-5054-48b7-898f-0f70d627050e" status: 200 len: 194 microversion: 2.20 time: 0.046356 Jul 05 10:17:21.894175 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 203/395] 10.222.0.16 () {60 vars in 1453 bytes} [Tue Jul 5 10:17:21 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments/10052bb3-5054-48b7-898f-0f70d627050e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:17:21.955603 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=13 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:21.956359 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:21.960832 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:21.961413 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:21.969711 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:21.970171 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:21.970971 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:21.971407 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:22.098402 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lazy-loading 'services' on Instance uuid 791f0134-8c12-4dfd-a93f-254bdfe7fded {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:22.215125 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-01b40183-a585-4282-ad0a-7df57bd8d9a1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments/10052bb3-5054-48b7-898f-0f70d627050e" status: 202 len: 0 microversion: 2.20 time: 0.261087 Jul 05 10:17:22.215719 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 193/396] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jul 5 10:17:21 2022] DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments/10052bb3-5054-48b7-898f-0f70d627050e => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:17:22.224299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:22.225216 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:22.232116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:22.232584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:22.233347 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:22.233778 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:22.263606 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-95f191a9-7138-49d0-bd1f-ba79b0fece4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043306 Jul 05 10:17:22.264176 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 204/397] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 5 10:17:22 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:17:23.276196 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:23.277232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:23.284520 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:23.284966 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:23.285755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:23.286175 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:23.316109 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b4a939c4-4bbb-4deb-a8ff-bc1c63c23ff7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044888 Jul 05 10:17:23.316668 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 194/398] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 5 10:17:23 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:17:24.328494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:24.329467 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:24.335862 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.336307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.337057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.337478 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.366932 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ebf8dd82-b56d-452b-babb-6c69f00a3c4c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042571 Jul 05 10:17:24.367503 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 205/399] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 5 10:17:24 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:24.427322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:24.427904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:24.435031 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.435479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.436231 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.436655 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.461639 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:17:24.546851 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-672a693b-37b0-4b04-b739-7f99f9d63fb3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 204 len: 0 microversion: 2.20 time: 0.123439 Jul 05 10:17:24.547533 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 195/400] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 5 10:17:24 2022] DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 05 10:17:24.555854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:24.556455 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:24.562684 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.563122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.563882 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:24.564308 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:24.773825 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:24.785048 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:24.786565 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:24.787704 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b83d08d4-9561-41a4-b5f6-884d4cd60cd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.235798 Jul 05 10:17:24.788256 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 206/401] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:24 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:25.807348 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:25.808060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:25.814985 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:25.815429 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:25.816192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:25.816625 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:26.003246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:26.011412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:26.012921 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:26.014145 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be8486a6-11a6-4bd4-923f-a6fb277225f7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.211132 Jul 05 10:17:26.014726 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 196/402] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:25 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:27.033413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:27.034008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:27.040228 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:27.040642 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:27.041420 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:27.041844 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:27.172182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:27.180636 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:27.182148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:27.183387 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-86fad228-b93a-4240-94c7-de32d71c936d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1724 microversion: 2.20 time: 0.154077 Jul 05 10:17:27.184006 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 207/403] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:27 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:27.741020 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-7b123456-90ee-4d66-9329-4183c8f172ad req-5a860232-a9da-4510-9bba-364d83bb54fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "791f0134-8c12-4dfd-a93f-254bdfe7fded", "name": "network-vif-deleted", "tag": "f23a92fd-11cb-4088-9995-bdb9bd627a73"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:27.749495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7b123456-90ee-4d66-9329-4183c8f172ad req-5a860232-a9da-4510-9bba-364d83bb54fc service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:27.749958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7b123456-90ee-4d66-9329-4183c8f172ad req-5a860232-a9da-4510-9bba-364d83bb54fc service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:27.768098 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-7b123456-90ee-4d66-9329-4183c8f172ad req-5a860232-a9da-4510-9bba-364d83bb54fc service nova] Creating event network-vif-deleted:f23a92fd-11cb-4088-9995-bdb9bd627a73 for instance 791f0134-8c12-4dfd-a93f-254bdfe7fded on hv-cinder-maste Jul 05 10:17:27.773643 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-7b123456-90ee-4d66-9329-4183c8f172ad req-5a860232-a9da-4510-9bba-364d83bb54fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036293 Jul 05 10:17:27.774271 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 197/404] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:28.202157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:28.202969 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:28.210868 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:28.211485 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:28.212330 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:28.213309 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:28.250632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:28.259580 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:28.260334 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lazy-loading 'fault' on Instance uuid 791f0134-8c12-4dfd-a93f-254bdfe7fded {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:28.312153 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:28.322623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:28.324152 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:28.325351 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c563e2bb-284b-4dd9-982f-186f03248723 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 200 len: 1372 microversion: 2.20 time: 0.127483 Jul 05 10:17:28.326811 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 208/405] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:28 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:29.349455 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:29.350511 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:29.360293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:29.360996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:29.362164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:29.362849 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:29.380847 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded HTTP/1.1 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:17:29.382533 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:17:29.384132 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '791f0134-8c12-4dfd-a93f-254bdfe7fded'} Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:17:29.385086 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:17:29.386514 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:29.387855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:17:29.387855 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-afac6b54-2693-4df9-9f49-e2173eabe2be tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 404 len: 111 microversion: 2.20 time: 0.042001 Jul 05 10:17:29.387855 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 198/406] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:29 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:17:29.392907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-776d53a2-765f-4a29-913e-554ff0725124 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '.version_select at 0x7ffbf0316f70>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:29.414458 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-776d53a2-765f-4a29-913e-554ff0725124 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639041059" status: 204 len: 0 microversion: 2.20 time: 0.025419 Jul 05 10:17:29.415010 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 209/407] 10.222.0.16 () {60 vars in 1261 bytes} [Tue Jul 5 10:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1639041059 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 10:17:30.085797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: .version_select at 0x7ffbf0415e50>, body: {"keypair": {"name": "tempest-keypair-481047421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1dUoIhuzgaThJwUfhD2RMBmc0EPTtshf8G2uOWvfvllVmn68SNkYNENTaZpbeUoFC2KIl0rv8M1miQIrmVtq9Vf12MUWVvPtzQrABXJxQIXX7ARpbTuwcqAMnLhciMmQ=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:30.101327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for project d343798527cf445295916cc8e8134bf3. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:17:30.105648 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for user 51e20b9a489342d2b8f0f85542ab370c and project d343798527cf445295916cc8e8134bf3. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:17:30.118825 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [9f828a92-e244-49c8-a06a-fd5329ffb7e1] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 10:17:31.130988 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [9f828a92-e244-49c8-a06a-fd5329ffb7e1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35964. Jul 05 10:17:31.153966 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3585257d-8cdd-4563-8c25-6ae2ac094392 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.072148 Jul 05 10:17:31.154593 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 199/408] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Jul 5 10:17:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1073 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 05 10:17:32.453684 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1500515202", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eec36f3b-26bf-47cd-bc08-cd0f11c95ea2"}], "security_groups": [{"name": "tempest-securitygroup--1786842890"}], "key_name": "tempest-keypair-481047421", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:32.562088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] validate_networks() for [('eec36f3b-26bf-47cd-bc08-cd0f11c95ea2', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:17:32.928919 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:17:32.929608 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:17:32.930427 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:17:32.931095 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:17:32.931777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:17:32.944550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:32.944974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:32.945760 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:32.946186 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:32.963560 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for project d343798527cf445295916cc8e8134bf3. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:17:32.967657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Getting quotas for user 51e20b9a489342d2b8f0f85542ab370c and project d343798527cf445295916cc8e8134bf3. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:17:32.979732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:17:32.982033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:17:33.040261 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0956744b-11dd-49e7-b655-55f5e6d06312 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.590795 Jul 05 10:17:33.040817 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 210/409] 10.222.0.16 () {62 vars in 1187 bytes} [Tue Jul 5 10:17:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 05 10:17:33.052078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:33.052666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:33.111335 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:33.119631 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:33.121159 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:33.122393 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-343d032b-9383-400a-9213-088cafe1efe4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1281 microversion: 2.20 time: 0.075150 Jul 05 10:17:33.122972 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 200/410] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:33 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:17:34.140247 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:34.141618 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:34.148952 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:34.149632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:34.150863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:34.151299 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:34.219353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:34.228641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:34.230298 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:34.231549 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-38618d7c-f87b-488a-a09d-19559434c76c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1341 microversion: 2.20 time: 0.095282 Jul 05 10:17:34.232206 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 211/411] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:34 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1341 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:35.250708 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:35.251338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:35.258748 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:35.259215 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:35.260005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:35.261837 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:35.400729 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:35.409700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:35.411589 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:35.412719 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f6a32f00-de8e-4cb3-8029-6e907e01b84c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.166160 Jul 05 10:17:35.413256 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 201/412] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:35 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:35.618514 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-d9f4e4e9-9fb1-43b6-80fd-21520dbde0ca req-57a9361e-d7f7-4bfc-809e-8cb7e38d1326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:35.632257 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d9f4e4e9-9fb1-43b6-80fd-21520dbde0ca req-57a9361e-d7f7-4bfc-809e-8cb7e38d1326 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:35.632695 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-d9f4e4e9-9fb1-43b6-80fd-21520dbde0ca req-57a9361e-d7f7-4bfc-809e-8cb7e38d1326 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:35.645738 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-d9f4e4e9-9fb1-43b6-80fd-21520dbde0ca req-57a9361e-d7f7-4bfc-809e-8cb7e38d1326 service nova] Creating event network-changed:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:17:35.651179 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-d9f4e4e9-9fb1-43b6-80fd-21520dbde0ca req-57a9361e-d7f7-4bfc-809e-8cb7e38d1326 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042312 Jul 05 10:17:35.652098 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 212/413] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:36.435807 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:36.436730 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:36.448071 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:36.448757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:36.450054 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:36.450817 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:36.586168 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:36.594920 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:36.596447 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:36.597636 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9af8148d-f883-4e55-8992-cf76019bbe0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.168838 Jul 05 10:17:36.598179 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 202/414] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:36 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:37.626388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:37.627488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:37.634632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:37.635136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:37.636096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:37.636727 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:37.776247 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:37.784572 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:37.786071 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:37.787227 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e36ee26b-d462-433b-83fd-7eca67332fdf tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.168023 Jul 05 10:17:37.787786 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 213/415] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:37 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:38.805848 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:38.806372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:38.813623 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:38.814078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:38.814890 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:38.815326 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:38.960155 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:38.968978 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:38.970587 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:38.971646 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c3521bff-f6af-42ba-a094-276545f40980 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.170482 Jul 05 10:17:38.972290 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 203/416] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:38 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:40.060374 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:40.060984 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:40.067579 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:40.068021 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:40.068781 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:40.069226 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:40.207568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:40.215932 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:40.217405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:40.218542 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d952686-13a5-4996-ba3d-1fa913bc5d33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.230972 Jul 05 10:17:40.219043 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 214/417] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:39 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:41.236749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:41.237372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:41.244183 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:41.244630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:41.245428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:41.245848 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:41.385873 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:41.394756 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:41.396269 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:41.397373 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4d2a4484-3993-41d6-822f-d7eed832c5dc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.164663 Jul 05 10:17:41.397938 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 204/418] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:41 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:42.420322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:42.421301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:42.429466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:42.429906 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:42.430701 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:42.431121 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:42.567673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:42.575946 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:42.577457 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:42.578593 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-23dd2af3-4149-4628-8587-f1b16fc97bde tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.165041 Jul 05 10:17:42.579190 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 215/419] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:42 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:42.593675 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:17:42.594196 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Jul 05 10:17:42.596372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-82bef160-df38-4dd0-9f62-900f8cfdf9c4 req-12926253-fe0c-4add-8599-87b31a242f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "name": "network-vif-plugged", "status": "completed", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:42.607958 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-82bef160-df38-4dd0-9f62-900f8cfdf9c4 req-12926253-fe0c-4add-8599-87b31a242f9a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:42.608913 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-82bef160-df38-4dd0-9f62-900f8cfdf9c4 req-12926253-fe0c-4add-8599-87b31a242f9a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:42.620567 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-82bef160-df38-4dd0-9f62-900f8cfdf9c4 req-12926253-fe0c-4add-8599-87b31a242f9a service nova] Creating event network-vif-plugged:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:17:42.625632 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-82bef160-df38-4dd0-9f62-900f8cfdf9c4 req-12926253-fe0c-4add-8599-87b31a242f9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035211 Jul 05 10:17:42.626238 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 205/420] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:43.600190 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:43.600900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:43.603096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:43.603830 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:43.610250 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:43.610749 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:43.611582 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:43.612060 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:43.753614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:43.762267 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:43.763791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:43.765558 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a0136f74-ee73-4004-b04e-ae322badcd27 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1407 microversion: 2.20 time: 0.170454 Jul 05 10:17:43.766399 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 216/421] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:43 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:44.782573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:44.787298 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:44.787988 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:44.794710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:44.795156 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:44.795922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:44.796353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:44.935008 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:44.945262 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:44.946815 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:44.947974 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-210394b0-d7db-41d8-8560-620a1f41317d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1598 microversion: 2.20 time: 0.166505 Jul 05 10:17:44.948538 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 206/422] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:17:44 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:17:44.966176 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:44.966792 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:44.973264 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:44.973701 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:44.974501 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:44.974938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:45.050376 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f6881218-59fe-4cf5-b96d-1c5337facbd4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088508 Jul 05 10:17:45.050967 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 217/423] 10.222.0.16 () {60 vars in 1315 bytes} [Tue Jul 5 10:17:44 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:17:46.229338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-d436bee7-5f0b-42f2-ab69-de62f0bc23e5 req-1d9e0e86-40c0-4e82-b457-d85d6f4a572d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:46.238540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d436bee7-5f0b-42f2-ab69-de62f0bc23e5 req-1d9e0e86-40c0-4e82-b457-d85d6f4a572d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:46.238985 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-d436bee7-5f0b-42f2-ab69-de62f0bc23e5 req-1d9e0e86-40c0-4e82-b457-d85d6f4a572d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:46.250555 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-d436bee7-5f0b-42f2-ab69-de62f0bc23e5 req-1d9e0e86-40c0-4e82-b457-d85d6f4a572d service nova] Creating event network-changed:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:17:46.256000 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-d436bee7-5f0b-42f2-ab69-de62f0bc23e5 req-1d9e0e86-40c0-4e82-b457-d85d6f4a572d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030271 Jul 05 10:17:46.256662 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 207/424] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:48.306108 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:48.306660 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:48.312728 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:48.313168 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:48.313913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:48.314356 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:48.396743 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'services' on Instance uuid 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:48.539916 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-161a6b7e-1078-4902-b57f-f1f7858e440d tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments/d794d8ef-0753-47ec-ab72-341a55849ffe" status: 202 len: 0 microversion: 2.1 time: 0.237224 Jul 05 10:17:48.540661 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 218/425] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:17:48 2022] DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments/d794d8ef-0753-47ec-ab72-341a55849ffe => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:17:48.553476 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:48.554524 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:48.561129 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:48.561573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:48.562370 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:48.562797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:48.593390 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-16b7b37d-bb5d-47d5-9d4d-1b7446f474fa tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Jul 05 10:17:48.593956 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 208/426] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:17:48 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:49.607642 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:49.608938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:49.617336 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.617887 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:49.618870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.619394 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:49.650018 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5be3ad91-1ccc-49b5-bb3d-d8439065b56c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047838 Jul 05 10:17:49.650619 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 219/427] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:17:49 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:17:49.726979 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:49.727496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:49.734142 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.734627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:49.735385 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.735790 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:49.761087 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:17:49.841618 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-457e9340-d3ec-4dd0-b272-a325f5c22125 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 204 len: 0 microversion: 2.1 time: 0.119322 Jul 05 10:17:49.842357 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 209/428] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:17:49 2022] DELETE /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:17:49.850680 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:49.851275 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:49.857406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.857901 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:49.858616 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:49.859044 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:50.012546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:50.023331 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7fad841-1cbc-4e33-9688-d2fa8e2f7a8f tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1688 microversion: 2.1 time: 0.176657 Jul 05 10:17:50.023901 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 220/429] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:49 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:17:51.045613 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:51.046804 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:51.056862 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:51.057303 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:51.058066 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:51.058523 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:51.063091 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:51.195318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:51.203169 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1952417d-9c26-48d6-b5d9-1cece3548f28 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1688 microversion: 2.1 time: 0.164811 Jul 05 10:17:51.203728 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 210/430] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:51 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:52.220682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:52.221263 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:52.223406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:52.230020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:52.230474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:52.231235 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:52.231665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:52.238852 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:52.371930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:52.383037 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-03117fdd-80f3-41b1-b57f-e4904a6b95d3 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1688 microversion: 2.1 time: 0.166011 Jul 05 10:17:52.383826 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 221/431] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:52 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:53.409379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:53.410423 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:53.414101 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:17:53.420111 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.420547 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.421333 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.421766 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.563273 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:53.571819 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-817e1cd0-7e0c-4da3-8092-cfe517ce9fc4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1688 microversion: 2.1 time: 0.168537 Jul 05 10:17:53.572010 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 211/432] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:53 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:53.653880 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:53.654547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:53.663401 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.664177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.664958 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.665389 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.687849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lazy-loading 'flavor' on Instance uuid edc74bf2-53b0-450e-a3d1-663ad51af48d {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:53.764138 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7d9f2b1-ffc9-4f1b-a35a-f0a12ffb7beb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "POST /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d/action" status: 202 len: 0 microversion: 2.1 time: 0.116536 Jul 05 10:17:53.764913 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 222/433] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:17:53 2022] POST /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:17:53.773282 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:53.773885 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:53.780027 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.780467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.781228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:53.781684 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:53.922578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:53.930513 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aadb7c1a-37f4-4685-aeab-1fa999903db0 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.161138 Jul 05 10:17:53.931090 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 212/434] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:53 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:17:54.454174 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9a1acd65-ef04-41f9-b3fe-e6db471e8801 req-5c65c3d5-ea3f-4055-84ae-29cec9d3167c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ee6f64-34a9-4c14-b5d8-aafbcc4913a5", "name": "network-vif-deleted", "tag": "35391f9a-9376-4c1c-89cf-2602eb5ad8dc"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:54.465398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9a1acd65-ef04-41f9-b3fe-e6db471e8801 req-5c65c3d5-ea3f-4055-84ae-29cec9d3167c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.465821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9a1acd65-ef04-41f9-b3fe-e6db471e8801 req-5c65c3d5-ea3f-4055-84ae-29cec9d3167c service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.478734 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9a1acd65-ef04-41f9-b3fe-e6db471e8801 req-5c65c3d5-ea3f-4055-84ae-29cec9d3167c service nova] Creating event network-vif-deleted:35391f9a-9376-4c1c-89cf-2602eb5ad8dc for instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 on hv-cinder-maste Jul 05 10:17:54.484762 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9a1acd65-ef04-41f9-b3fe-e6db471e8801 req-5c65c3d5-ea3f-4055-84ae-29cec9d3167c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095721 Jul 05 10:17:54.485859 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 223/435] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:54.588795 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:54.589409 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:54.596006 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.596450 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.597220 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.597650 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.631699 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.632439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.633153 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'fault' on Instance uuid 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:54.675040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:54.682728 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-78c519ef-de2b-4a8f-803f-cedea2c94d62 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 200 len: 1334 microversion: 2.1 time: 0.098656 Jul 05 10:17:54.683405 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 213/436] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:54 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:54.902020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:54.902715 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:54.909524 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.909975 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.910776 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.911207 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.934558 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c494313f-4067-4b7e-8544-4df23def367c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/ips" status: 200 len: 150 microversion: 2.1 time: 0.037006 Jul 05 10:17:54.935134 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 224/437] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:17:54 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:54.947550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:54.948423 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:54.948551 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d236c54-beec-4e55-a230-7e6097b25255"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:54.949806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:54.956752 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.957202 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.957846 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.958208 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.958672 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.958859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:54.959788 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:54.960368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.055259 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: POST /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/os-volume_attachments HTTP/1.1 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 74 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:17:55.058469 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: {"volumeAttachment": {"volumeId": "0d236c54-beec-4e55-a230-7e6097b25255"}} Jul 05 10:17:55.060134 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'server_id': '056f41b2-532d-4fd1-8892-10ef1c06cfb4', 'body': {'volumeAttachment': {'volumeId': '0d236c54-beec-4e55-a230-7e6097b25255'}}} Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.061060 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.062523 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:55.063904 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:55.063904 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:17:55.063904 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:17:55.063904 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 Jul 05 10:17:55.063904 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.065512 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 400 to user: Invalid volume: volume 0d236c54-beec-4e55-a230-7e6097b25255 is already attached to instances: b30ebea8-e028-471f-8d15-0513972e2331 {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:17:55.066748 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4535ad5-2886-4a26-a961-9f7637bd30e2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124772 Jul 05 10:17:55.068165 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 214/438] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:17:54 2022] POST /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:17:55.077096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:55.077709 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:55.086078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.086840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.087848 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.088869 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.109047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:55.114812 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:17:55.117753 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2877a915-9230-464a-a9d3-b1107cf91f5d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.173920 Jul 05 10:17:55.119086 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 225/439] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:54 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:55.197311 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fccb6f6a-c6d1-4bf4-b7da-c478435d0e72 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 204 len: 0 microversion: 2.1 time: 0.124273 Jul 05 10:17:55.198001 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 215/440] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:17:55 2022] DELETE /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 10:17:55.206447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:55.207147 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:55.213941 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.214412 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.215161 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.215582 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.354490 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:55.362072 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70f70597-3858-462e-9fad-4a678524dca1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1680 microversion: 2.1 time: 0.159593 Jul 05 10:17:55.362700 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 226/441] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:55 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:55.704784 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:55.705764 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:55.717133 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.717880 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.719198 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:55.719919 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:55.736157 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] HTTP exception thrown: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Request method failure captured: Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 HTTP/1.1 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6Nun9DRgjvvp1RovVHa3pWnEaJSrhwN5YnUCPEPtraVs8X__jyqVw9PJK9HMVsfrS7r6WU_LwQL7OG3sPG6fP33KhsffAg-MHEpEKA7bPzEwHHbnPCbXWNCCssljiQx7AvIJVTIHTvNQ4IdKFeaU2H5W_bDXl-sftGusHE7lFkBEQ Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:17:55.737761 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 3c6e5faddabd4208b6e476be4b59e834 Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. Jul 05 10:17:55.739276 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '22ee6f64-34a9-4c14-b5d8-aafbcc4913a5'} Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:17:55.740095 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. Jul 05 10:17:55.741244 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:55.742512 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Returning 404 to user: Instance 22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:17:55.742512 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9d0083df-df7a-488c-b23b-e819448534ee tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5" status: 404 len: 111 microversion: 2.1 time: 0.041740 Jul 05 10:17:55.742512 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 216/442] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:55 2022] GET /compute/v2.1/servers/22ee6f64-34a9-4c14-b5d8-aafbcc4913a5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:17:55.747900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9e4c16e5-1439-4919-bbf6-e9f347d73ac7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '.version_select at 0x7ffbf04193a0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:55.768507 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9e4c16e5-1439-4919-bbf6-e9f347d73ac7 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-76834046" status: 202 len: 0 microversion: 2.1 time: 0.024372 Jul 05 10:17:55.769144 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 227/443] 10.222.0.16 () {58 vars in 1214 bytes} [Tue Jul 5 10:17:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-76834046 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:17:56.135712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:56.136175 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:56.142717 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:56.143142 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:56.143946 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:56.144369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:56.349176 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:56.357274 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-49a10cbe-f06c-419a-af61-eb652966938b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.225770 Jul 05 10:17:56.357862 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 217/444] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:56 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:56.379296 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:56.379867 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:56.386094 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:56.386594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:56.387345 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:56.387782 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:56.558562 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:56.567220 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b419754-0dc4-48e3-aacc-35ec073f4dad tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1680 microversion: 2.1 time: 0.191880 Jul 05 10:17:56.567944 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 228/445] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:56 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:57.377815 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:57.378585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:57.386719 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:57.387168 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:57.387943 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:57.388382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:57.522197 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:57.530256 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-394e2ae5-d0d6-4bca-9a94-54dda9e89c62 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.158478 Jul 05 10:17:57.530826 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 218/446] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:57 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:57.585328 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:57.586012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:57.592830 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:57.593362 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:57.594379 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:57.594817 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:57.741038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:57.750298 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d76b16c3-30c0-4394-8cb6-4657f7a261f1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 200 len: 1680 microversion: 2.1 time: 0.169017 Jul 05 10:17:57.751209 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 229/447] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:57 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:58.168273 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-953dc916-0de9-4a39-92a7-a6b18949c81e req-385a3bc7-b650-4d80-94c2-3776395f9c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "056f41b2-532d-4fd1-8892-10ef1c06cfb4", "name": "network-vif-deleted", "tag": "ff357201-1c14-46dd-afe9-da456b9b848f"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:17:58.177873 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-953dc916-0de9-4a39-92a7-a6b18949c81e req-385a3bc7-b650-4d80-94c2-3776395f9c8d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.178556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-953dc916-0de9-4a39-92a7-a6b18949c81e req-385a3bc7-b650-4d80-94c2-3776395f9c8d service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.193088 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-953dc916-0de9-4a39-92a7-a6b18949c81e req-385a3bc7-b650-4d80-94c2-3776395f9c8d service nova] Creating event network-vif-deleted:ff357201-1c14-46dd-afe9-da456b9b848f for instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 on hv-cinder-maste Jul 05 10:17:58.198762 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-953dc916-0de9-4a39-92a7-a6b18949c81e req-385a3bc7-b650-4d80-94c2-3776395f9c8d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Jul 05 10:17:58.200110 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 219/448] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:17:58.548024 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:58.548635 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:58.555203 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.555647 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.556465 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.556900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.694485 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:58.703681 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1fd6c09a-f7d8-4219-ad1a-73bd2b581f3d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.159622 Jul 05 10:17:58.713858 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 230/449] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:58 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:17:58.770394 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:58.771759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:58.779065 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.779722 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.780671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.781103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.791226 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:58.791979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:58.797266 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:17:58.798003 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.798474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 HTTP/1.1 Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:17:58.799197 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:17:58.800718 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '056f41b2-532d-4fd1-8892-10ef1c06cfb4'} Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:17:58.801660 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:17:58.803177 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:17:58.804598 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:17:58.804598 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1d1b5799-41b5-4277-a078-8130bfe221ec tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 404 len: 111 microversion: 2.1 time: 0.035884 Jul 05 10:17:58.804598 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 220/450] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:58 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:17:58.805196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.805666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.809685 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e8fe08d3-ec1f-41c8-9741-aa4aceddcd86 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '.version_select at 0x7ffbf01ef0d0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:58.829923 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e8fe08d3-ec1f-41c8-9741-aa4aceddcd86 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736414556" status: 202 len: 0 microversion: 2.1 time: 0.024318 Jul 05 10:17:58.830802 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 221/451] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jul 5 10:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736414556 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:17:58.833111 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:17:58.946435 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ef3a430a-f5d5-40f3-954e-eff931f43b5c tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 204 len: 0 microversion: 2.1 time: 0.158676 Jul 05 10:17:58.947404 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 231/452] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:17:58 2022] DELETE /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 10:17:58.955614 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:58.956573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:58.966285 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.967104 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:58.967960 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:58.968511 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.122243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:59.130549 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cfe78d28-d09a-4edc-8124-22754b34c8f4 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1507 microversion: 2.1 time: 0.178780 Jul 05 10:17:59.131164 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 222/453] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:58 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:17:59.531459 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:59.532162 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:59.538731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.539173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.539931 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.540361 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.621116 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lazy-loading 'services' on Instance uuid b30ebea8-e028-471f-8d15-0513972e2331 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:17:59.702353 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5d939285-b2cf-4a22-b06d-0a059b3cc01f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments/0d236c54-beec-4e55-a230-7e6097b25255" status: 202 len: 0 microversion: 2.1 time: 0.175006 Jul 05 10:17:59.702943 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 232/454] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:17:59 2022] DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments/0d236c54-beec-4e55-a230-7e6097b25255 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:17:59.714595 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:59.715523 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:59.721283 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:17:59.721944 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.722097 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:17:59.722427 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.723193 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.723621 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.728441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.728879 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.729623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:17:59.730047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:17:59.753849 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e3b23c86-bde6-49af-9539-4d105fa4d7e4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045883 Jul 05 10:17:59.758328 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 223/455] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:17:59 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:17:59.861689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:17:59.869974 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cdf110c2-fbd7-448f-9c64-f5142d362511 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.152917 Jul 05 10:17:59.870596 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 233/456] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:17:59 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:00.151683 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:00.152665 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:00.164485 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.165222 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:00.166855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.167515 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:00.311496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:00.319122 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-04bf81ea-2522-4114-8054-00bf85718e70 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1507 microversion: 2.1 time: 0.173992 Jul 05 10:18:00.319723 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 224/457] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:00 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:00.766828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:00.767802 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:00.776498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.776941 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:00.777705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.778144 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:00.807343 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-06edf349-4843-49c6-aa20-2a515af92ebf tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Jul 05 10:18:00.807897 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 234/458] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:18:00 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:00.890783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:00.892024 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:00.902209 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.903006 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:00.904301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:00.905079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:01.054775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:01.063011 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0e527c48-8620-4da6-929a-2ee04aa30aee tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.178721 Jul 05 10:18:01.072882 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 225/459] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:00 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:01.340088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:01.340626 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:01.347863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:01.347863 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:01.348375 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:01.348809 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:01.366387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:01.499513 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:01.507655 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f58a4047-a10d-4303-a0d9-f31e155ccdda tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1507 microversion: 2.1 time: 0.172698 Jul 05 10:18:01.508282 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 235/460] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:01 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:01.821863 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:01.823217 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:01.830065 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:01.830548 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:01.831336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:01.831759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:01.862264 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8d794d7e-2b83-4d12-9c9f-a4369f89c9b2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Jul 05 10:18:01.862853 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 226/461] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:18:01 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:02.080611 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:02.081303 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:02.087635 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.088075 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.089189 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.089617 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.226844 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:02.235138 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3584b1d3-e092-4050-a2e4-5c73a4f342f5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.158385 Jul 05 10:18:02.235831 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 236/462] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:02 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:02.527040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:02.527790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:02.531603 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-cad0e330-12fa-472d-af59-5eafd8b97138 req-dcf4949e-dd09-4382-bc42-04269a9d6d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea4c03a-7d8a-4595-a5a7-e70971848db7", "name": "network-vif-deleted", "tag": "25d94d3c-deb0-4986-b0a3-a69d62aa8fce"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:02.538155 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.539387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.540220 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.540650 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.540799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-cad0e330-12fa-472d-af59-5eafd8b97138 req-dcf4949e-dd09-4382-bc42-04269a9d6d32 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.541242 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-cad0e330-12fa-472d-af59-5eafd8b97138 req-dcf4949e-dd09-4382-bc42-04269a9d6d32 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.557610 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-cad0e330-12fa-472d-af59-5eafd8b97138 req-dcf4949e-dd09-4382-bc42-04269a9d6d32 service nova] Creating event network-vif-deleted:25d94d3c-deb0-4986-b0a3-a69d62aa8fce for instance eea4c03a-7d8a-4595-a5a7-e70971848db7 on hv-cinder-maste Jul 05 10:18:02.566179 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-cad0e330-12fa-472d-af59-5eafd8b97138 req-dcf4949e-dd09-4382-bc42-04269a9d6d32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038621 Jul 05 10:18:02.568061 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 227/463] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:02.620332 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:02.628441 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cab00e2b-913e-496a-9a8c-56bdd5b17a42 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 200 len: 1465 microversion: 2.1 time: 0.105789 Jul 05 10:18:02.629048 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 237/464] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:02 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 1465 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:02.876780 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:02.877796 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:02.884842 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.885328 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.886128 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.886583 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.904228 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:02.919314 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e15a6cc7-9612-4efb-be95-e094215476eb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046827 Jul 05 10:18:02.919906 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 228/465] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:18:02 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:18:02.982977 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:02.983445 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:02.989979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.990552 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:02.991190 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:02.991620 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.018090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:18:03.105171 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-53c428d5-6b5c-4026-a0b4-d4d58200d281 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 204 len: 0 microversion: 2.1 time: 0.126168 Jul 05 10:18:03.106013 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 238/466] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:18:02 2022] DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:18:03.116256 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:03.116872 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:03.125074 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.125684 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.126504 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.126941 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.253088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:03.254069 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:03.260534 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.260981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.261945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.262266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.264720 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:03.272330 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bd07bf58-564c-415c-95f9-4a8d47576d77 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1681 microversion: 2.1 time: 0.161732 Jul 05 10:18:03.272903 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 229/467] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:03 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:03.394090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:03.401791 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1d431044-ff4c-43d7-bbde-906b5af028a8 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.153017 Jul 05 10:18:03.402400 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 239/468] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:03 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:18:03.652680 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:03.653232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: eea4c03a-7d8a-4595-a5a7-e70971848db7] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:03.659819 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.660272 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.661046 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.661488 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.675311 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] HTTP exception thrown: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Request method failure captured: Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 HTTP/1.1 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6Nun9DRgjvvp1RovVHa3pWnEaJSrhwN5YnUCPEPtraVs8X__jyqVw9PJK9HMVsfrS7r6WU_LwQL7OG3sPG6fP33KhsffAg-MHEpEKA7bPzEwHHbnPCbXWNCCssljiQx7AvIJVTIHTvNQ4IdKFeaU2H5W_bDXl-sftGusHE7lFkBEQ Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:18:03.676952 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 3c6e5faddabd4208b6e476be4b59e834 Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. Jul 05 10:18:03.678406 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'eea4c03a-7d8a-4595-a5a7-e70971848db7'} Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:18:03.679275 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. Jul 05 10:18:03.680661 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:03.682199 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Returning 404 to user: Instance eea4c03a-7d8a-4595-a5a7-e70971848db7 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:18:03.682199 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5f7ded15-0d7b-459e-a54a-a064f9090722 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7" status: 404 len: 111 microversion: 2.1 time: 0.032725 Jul 05 10:18:03.682199 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 230/469] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:03 2022] GET /compute/v2.1/servers/eea4c03a-7d8a-4595-a5a7-e70971848db7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:03.687052 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:03.687549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:03.694032 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.694529 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.695289 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.695720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.721682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:18:03.800905 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7d438002-6e32-4dea-a92a-42d31f3a2c50 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 204 len: 0 microversion: 2.1 time: 0.117576 Jul 05 10:18:03.801484 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 240/470] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:18:03 2022] DELETE /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 10:18:03.809680 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:03.810327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:03.816453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.816898 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.817679 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:03.818107 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:03.948248 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:03.956031 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e784e429-0a0e-4a2a-80b7-6c6f4387e701 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.150251 Jul 05 10:18:03.956583 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 231/471] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:03 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:04.293979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:04.295126 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:04.305573 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.306356 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:04.307601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.308314 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:04.418188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:04.418909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:04.425361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.425890 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:04.426693 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.427123 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:04.457669 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:04.465738 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ff102835-10ec-4e20-9cb7-b6b4953c256a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1681 microversion: 2.1 time: 0.178945 Jul 05 10:18:04.466357 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 241/472] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:04 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:04.559485 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:04.567422 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-eebea7c2-8570-49d3-98ed-3a51a49172f3 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.153062 Jul 05 10:18:04.568089 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 232/473] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:04 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:04.976937 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:04.977878 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:04.988255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.988985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:04.990268 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:04.990979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:05.127139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:05.135302 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c4167ecd-1f00-4105-9d83-4dd511ad2aba tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.164875 Jul 05 10:18:05.135893 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 242/474] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:04 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:05.484456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:05.485090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:05.492537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:05.492979 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:05.493747 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:05.494180 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:05.586980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:05.587509 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:05.594548 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:05.594973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:05.595735 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:05.596185 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:05.642843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:05.650837 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4aa2fc28-338c-4fc8-99a6-ef24a2d4b771 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1681 microversion: 2.1 time: 0.170980 Jul 05 10:18:05.651423 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 233/475] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:05 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:05.736364 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:05.748790 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-696f4bed-259f-412f-ba3f-e5ffb2c16c78 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.165798 Jul 05 10:18:05.749367 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 243/476] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:05 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:06.156479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:06.157473 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:06.167985 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.168601 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.169367 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.169803 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.302941 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:06.314085 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d45768e7-6b9b-486c-8f9b-5f75083fc366 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.163815 Jul 05 10:18:06.315102 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 234/477] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:06 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:06.669193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:06.669865 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:06.676985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.677471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.678325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.678803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.766207 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:06.766847 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:06.773858 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.774376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.775190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:06.775604 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:06.807330 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:06.815537 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f568ab37-5990-41ca-8a99-f8cb23436916 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1681 microversion: 2.1 time: 0.150771 Jul 05 10:18:06.816082 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 244/478] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:06 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:06.906953 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:06.915138 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d0edf352-4eb6-4701-8d10-105f92c2e52b tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.152868 Jul 05 10:18:06.915712 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 235/479] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:06 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:07.333198 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:07.333804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:07.342403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.342914 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:07.343993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.344506 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:07.497902 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:07.505775 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d80c6087-abd8-4dab-849d-614404fee693 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1522 microversion: 2.1 time: 0.176882 Jul 05 10:18:07.506393 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 245/480] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:07 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:07.833461 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:07.834810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:07.842323 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.843185 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:07.844227 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.844666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:07.932474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:07.933104 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:07.940300 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.940746 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:07.941510 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:07.941945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:08.173406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:08.181364 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-528b26b5-c2ec-48fd-ac85-27b44ef6c6f4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1681 microversion: 2.1 time: 0.352142 Jul 05 10:18:08.181949 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 236/481] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:07 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1681 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:18:08.237359 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:08.246639 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6f4ef735-15ba-4529-a547-a045d57e9aa6 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.318035 Jul 05 10:18:08.258246 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:07 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:08.294108 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-da9e43ad-f4ae-4dd3-a8e4-5ecaa3f0d353 req-db28016e-98c4-480d-a31f-507b129e7aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d51ee6e-4926-463c-82fa-66b06c93c8da", "name": "network-vif-deleted", "tag": "b589a7dd-d1a3-4310-859e-041c8d2387f9"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:08.302712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-da9e43ad-f4ae-4dd3-a8e4-5ecaa3f0d353 req-db28016e-98c4-480d-a31f-507b129e7aa8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:08.303458 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-da9e43ad-f4ae-4dd3-a8e4-5ecaa3f0d353 req-db28016e-98c4-480d-a31f-507b129e7aa8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:08.314870 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-da9e43ad-f4ae-4dd3-a8e4-5ecaa3f0d353 req-db28016e-98c4-480d-a31f-507b129e7aa8 service nova] Creating event network-vif-deleted:b589a7dd-d1a3-4310-859e-041c8d2387f9 for instance 6d51ee6e-4926-463c-82fa-66b06c93c8da on hv-cinder-maste Jul 05 10:18:08.319867 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-da9e43ad-f4ae-4dd3-a8e4-5ecaa3f0d353 req-db28016e-98c4-480d-a31f-507b129e7aa8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117356 Jul 05 10:18:08.320880 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 237/483] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:08.522794 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:08.523590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:08.530601 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:08.531135 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:08.532342 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:08.532777 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:08.566404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:08.566404 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:08.567157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lazy-loading 'fault' on Instance uuid 6d51ee6e-4926-463c-82fa-66b06c93c8da {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:18:08.611322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6e5faddabd4208b6e476be4b59e834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de80b31cd6c144ac838b613648f8f3a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:08.618924 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-95109e95-1b4b-4a42-93dd-d3d2da2da0b8 tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 200 len: 1312 microversion: 2.1 time: 0.100134 Jul 05 10:18:08.619981 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 247/484] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:08 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:09.021000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-680230c3-f5ac-44eb-9e75-93373bd43ec4 req-993b1b37-0d72-4582-b191-33276c4d9276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30ebea8-e028-471f-8d15-0513972e2331", "name": "network-vif-deleted", "tag": "0bf2d319-5b77-400d-b259-32aa9a04c0d7"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:09.029403 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-680230c3-f5ac-44eb-9e75-93373bd43ec4 req-993b1b37-0d72-4582-b191-33276c4d9276 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.029904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-680230c3-f5ac-44eb-9e75-93373bd43ec4 req-993b1b37-0d72-4582-b191-33276c4d9276 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.042200 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-680230c3-f5ac-44eb-9e75-93373bd43ec4 req-993b1b37-0d72-4582-b191-33276c4d9276 service nova] Creating event network-vif-deleted:0bf2d319-5b77-400d-b259-32aa9a04c0d7 for instance b30ebea8-e028-471f-8d15-0513972e2331 on hv-cinder-maste Jul 05 10:18:09.047002 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-680230c3-f5ac-44eb-9e75-93373bd43ec4 req-993b1b37-0d72-4582-b191-33276c4d9276 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Jul 05 10:18:09.047618 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 238/485] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:09.198976 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:09.199466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:09.205871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.206340 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.207110 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.207544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.222918 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:09.264995 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:09.265933 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:09.272938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:09.273281 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.273727 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.274516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.274947 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.280867 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-89baf460-adb4-4cbf-af55-8b48281fc732 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1614 microversion: 2.1 time: 0.085816 Jul 05 10:18:09.281634 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 248/486] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:09 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:09.407839 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:09.415854 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-497a19d1-555c-43b9-86cb-c61a446dcf69 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.155091 Jul 05 10:18:09.416402 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 239/487] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:09 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:18:09.637004 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:09.637520 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] [instance: 6d51ee6e-4926-463c-82fa-66b06c93c8da] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:09.644858 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.645310 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.646081 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:09.646544 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:09.660165 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] HTTP exception thrown: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Request method failure captured: Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da HTTP/1.1 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6Nun9DRgjvvp1RovVHa3pWnEaJSrhwN5YnUCPEPtraVs8X__jyqVw9PJK9HMVsfrS7r6WU_LwQL7OG3sPG6fP33KhsffAg-MHEpEKA7bPzEwHHbnPCbXWNCCssljiQx7AvIJVTIHTvNQ4IdKFeaU2H5W_bDXl-sftGusHE7lFkBEQ Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:18:09.661811 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/de80b31cd6c144ac838b613648f8f3a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: de80b31cd6c144ac838b613648f8f3a7 Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1437134000 Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 3c6e5faddabd4208b6e476be4b59e834 Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1437134000-project Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. Jul 05 10:18:09.663377 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '6d51ee6e-4926-463c-82fa-66b06c93c8da'} Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:18:09.664333 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. Jul 05 10:18:09.665825 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:18:09.667142 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] Returning 404 to user: Instance 6d51ee6e-4926-463c-82fa-66b06c93c8da could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:18:09.667142 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1133c0b3-4d6c-4ea7-ac9f-0deea4e13e6b tempest-ServerRescueNegativeTestJSON-1437134000 tempest-ServerRescueNegativeTestJSON-1437134000-project] 10.222.0.16 "GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da" status: 404 len: 111 microversion: 2.1 time: 0.030458 Jul 05 10:18:09.667142 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 249/488] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:09 2022] GET /compute/v2.1/servers/6d51ee6e-4926-463c-82fa-66b06c93c8da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:10.298756 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:10.299538 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:10.306458 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:10.307219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:10.308224 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:10.308857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:10.341338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:10.341948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:10.342506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lazy-loading 'fault' on Instance uuid b30ebea8-e028-471f-8d15-0513972e2331 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:18:10.388637 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:10.396723 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1f0b1b13-5f06-43cc-8e53-3d8d66de338e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 200 len: 1331 microversion: 2.1 time: 0.102117 Jul 05 10:18:10.397302 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 240/489] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:10 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:10.432820 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:10.433396 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:10.439991 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:10.440270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:10.441035 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:10.441453 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:10.572824 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:10.582451 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ca083d90-4ff1-4c6e-91fc-26cad8776882 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.151782 Jul 05 10:18:10.583374 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 250/490] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:10 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:11.413246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:11.413870 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:11.420970 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.421422 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.422196 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.422689 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.437056 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 HTTP/1.1 Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:18:11.439285 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:18:11.440881 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'b30ebea8-e028-471f-8d15-0513972e2331'} Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:18:11.441700 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:18:11.442906 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:18:11.443992 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:18:11.443992 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-680e0976-3aa6-4b88-a937-0b4d3fd34cfa tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jul 05 10:18:11.443992 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 241/491] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:11 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:18:11.450555 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-31f344a9-5e4f-48df-ae21-870b381dc13e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '.version_select at 0x7ffbf024a310>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:11.472303 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-31f344a9-5e4f-48df-ae21-870b381dc13e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406604727" status: 202 len: 0 microversion: 2.1 time: 0.025795 Jul 05 10:18:11.473029 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 251/492] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 5 10:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406604727 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:18:11.600664 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:11.601592 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:11.607873 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.608545 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.609466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.610062 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.792216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:11.800470 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c95e93de-e210-4649-8b2b-763183c5620e tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1508 microversion: 2.1 time: 0.203614 Jul 05 10:18:11.801042 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 242/493] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:11 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:11.817472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:11.817598 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:11.824447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.825408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.826284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.826709 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.907370 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-34d28da2-5c45-4566-923f-e20a1985901f tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "POST /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d/action" status: 202 len: 0 microversion: 2.1 time: 0.094085 Jul 05 10:18:11.908567 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 252/494] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:18:11 2022] POST /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:18:11.918699 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:11.919728 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:11.928499 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.929950 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:11.931571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:11.933032 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:12.120229 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:12.128143 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0d6b041c-42af-442b-a16b-7f9bbcddf515 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1516 microversion: 2.1 time: 0.214818 Jul 05 10:18:12.128803 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 243/495] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:11 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:12.487175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7f652e59-3799-44ec-b0fc-c29b7c0f45d6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: .version_select at 0x7ffbf0313820>, body: {"keypair": {"name": "tempest-keypair-985116597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO4prHgZ3PifYtiZhwcROZIYBgEfh2Fxy76YAwK0SqIVKiLhex6pxouB2cqCvZEweVS6YyoHqg3oYfI7TZq8MeAY+w5SyH3oN4PRRKf9hgwSAjfv6Zmjnug+jJ9YY7mCw=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:12.502009 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-7f652e59-3799-44ec-b0fc-c29b7c0f45d6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:18:12.506023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-7f652e59-3799-44ec-b0fc-c29b7c0f45d6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:18:12.521834 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:12.544476 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7f652e59-3799-44ec-b0fc-c29b7c0f45d6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060977 Jul 05 10:18:12.550666 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 253/496] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:18:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:13.145490 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:13.146109 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:13.179210 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:13.179991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:13.181003 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:13.181639 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:13.458620 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:13.469313 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b8115a7f-e15e-453b-a2ca-c1ac7490af22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1518 microversion: 2.1 time: 0.327971 Jul 05 10:18:13.470157 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 244/497] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:13 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1518 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:18:14.245078 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1268661865", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98b9981-e889-405e-93b5-a13b417620de"}], "security_groups": [{"name": "tempest-securitygroup--286400400"}], "key_name": "tempest-keypair-985116597", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:14.353432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] validate_networks() for [('c98b9981-e889-405e-93b5-a13b417620de', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:18:14.487070 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:14.488459 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:14.497000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:14.497802 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:14.499103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:14.499754 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:14.669856 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:14.679051 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-00c65d8f-8e8c-471b-8a1e-7d2aa3340c28 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1574 microversion: 2.1 time: 0.195833 Jul 05 10:18:14.679632 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 245/498] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:14 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:18:14.911287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-b8f07565-8b83-4d04-b34a-17c771636b36 req-27d071ac-70ce-477b-9780-23858b2e091b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "name": "network-vif-unplugged", "status": "completed", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:14.919666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b8f07565-8b83-4d04-b34a-17c771636b36 req-27d071ac-70ce-477b-9780-23858b2e091b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:14.920113 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b8f07565-8b83-4d04-b34a-17c771636b36 req-27d071ac-70ce-477b-9780-23858b2e091b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:14.932899 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-b8f07565-8b83-4d04-b34a-17c771636b36 req-27d071ac-70ce-477b-9780-23858b2e091b service nova] Creating event network-vif-unplugged:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:18:14.939890 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-b8f07565-8b83-4d04-b34a-17c771636b36 req-27d071ac-70ce-477b-9780-23858b2e091b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.219426 Jul 05 10:18:14.940663 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 246/499] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:18:15.258509 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:18:15.259026 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:18:15.259379 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:18:15.259784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:18:15.260223 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:18:15.269188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:15.269629 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:15.270547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:15.270979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:15.288227 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:18:15.292296 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:18:15.303318 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:18:15.305587 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:18:15.353729 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-72bc931b-6db6-40ec-943f-22437ab5fd68 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.113496 Jul 05 10:18:15.359522 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 254/500] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:18:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:18:15.365222 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-620760e2-e3dc-42a6-adb3-c32e8488435f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:15.366022 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-620760e2-e3dc-42a6-adb3-c32e8488435f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:15.425318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-620760e2-e3dc-42a6-adb3-c32e8488435f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:15.432004 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-620760e2-e3dc-42a6-adb3-c32e8488435f tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1241 microversion: 2.1 time: 0.071083 Jul 05 10:18:15.432570 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 247/501] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:15 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:15.696904 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:15.697569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:15.704377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:15.704849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:15.705630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:15.706125 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:15.845804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:15.853104 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-97c8f0c5-56d9-4fdf-95d3-88ab289d02b5 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1574 microversion: 2.1 time: 0.161407 Jul 05 10:18:15.853672 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 255/502] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:15 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:16.451466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:16.452104 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:16.460634 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:16.461102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:16.461863 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:16.462322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:16.533968 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:16.542434 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6c32de88-0ca4-4948-8265-f4c143190dbd tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1245 microversion: 2.1 time: 0.095044 Jul 05 10:18:16.543063 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 248/503] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:16 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:16.871177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:16.871860 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:16.878334 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:16.878784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:16.879571 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:16.879998 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:17.068060 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:17.077623 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5b063823-f2e1-4002-b20e-bdd472b0aad2 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1574 microversion: 2.1 time: 0.210938 Jul 05 10:18:17.078506 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 256/504] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:16 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:17.559692 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:17.560380 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:17.567164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:17.567606 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:17.568361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:17.568795 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:17.573020 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=100 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:17.633405 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:17.641242 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-84cb71ac-7eb0-4116-981f-6add3c6cd374 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1293 microversion: 2.1 time: 0.085568 Jul 05 10:18:17.641847 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 249/505] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:17 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:18.095193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:18.095794 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:18.102028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:18.102506 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:18.103260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:18.103694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:18.246411 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:18.254212 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-70a4f8fc-cb0a-416d-9b8d-c1504666fe22 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1574 microversion: 2.1 time: 0.162910 Jul 05 10:18:18.255284 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 257/506] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:18 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:18.660063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:18.660830 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:18.667079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:18.667519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:18.668465 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:18.669121 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:18.735416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:18.743562 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1288e707-7902-4cee-8303-5ba212ed2d84 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1299 microversion: 2.1 time: 0.088599 Jul 05 10:18:18.744115 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 250/507] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:18 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:19.271936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:19.273356 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:19.284595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:19.285368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:19.286645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:19.287341 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:19.465398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:19.474652 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9132656a-fd0c-42a6-84d9-4d08238b5569 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1561 microversion: 2.1 time: 0.207316 Jul 05 10:18:19.475590 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 258/508] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:19 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1561 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:19.762750 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:19.765687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:19.772758 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:19.773428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:19.774203 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:19.774666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:19.910408 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:19.918491 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9d0ff668-c3ab-47e0-96ff-2a1d30090a05 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.160072 Jul 05 10:18:19.919824 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 251/509] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:19 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:20.800835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f17d5929-2bda-42cf-b620-8212517aa034 req-159ba31f-8d2b-42a2-b753-c594d94dd230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "name": "network-vif-plugged", "status": "completed", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:20.814519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f8a7f2d0-c5f3-4a14-8220-ab590c83d51b req-817fc94a-a6cc-4c10-8c52-f315d8aa4072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7601d2a5-817c-4e1c-b38c-6fae04f45c03", "tag": "0464b48e-8cb3-4e38-a628-d78665810656"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:20.833563 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f17d5929-2bda-42cf-b620-8212517aa034 req-159ba31f-8d2b-42a2-b753-c594d94dd230 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:20.841096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f8a7f2d0-c5f3-4a14-8220-ab590c83d51b req-817fc94a-a6cc-4c10-8c52-f315d8aa4072 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:20.841651 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f8a7f2d0-c5f3-4a14-8220-ab590c83d51b req-817fc94a-a6cc-4c10-8c52-f315d8aa4072 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:20.843532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f17d5929-2bda-42cf-b620-8212517aa034 req-159ba31f-8d2b-42a2-b753-c594d94dd230 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:20.860537 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f8a7f2d0-c5f3-4a14-8220-ab590c83d51b req-817fc94a-a6cc-4c10-8c52-f315d8aa4072 service nova] Creating event network-changed:0464b48e-8cb3-4e38-a628-d78665810656 for instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 on hv-cinder-maste Jul 05 10:18:20.870207 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-f17d5929-2bda-42cf-b620-8212517aa034 req-159ba31f-8d2b-42a2-b753-c594d94dd230 service nova] Creating event network-vif-plugged:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:18:20.875219 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f8a7f2d0-c5f3-4a14-8220-ab590c83d51b req-817fc94a-a6cc-4c10-8c52-f315d8aa4072 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064864 Jul 05 10:18:20.875838 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 252/510] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:20.877407 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f17d5929-2bda-42cf-b620-8212517aa034 req-159ba31f-8d2b-42a2-b753-c594d94dd230 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081452 Jul 05 10:18:20.878249 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 259/511] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:20.937689 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:20.938724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:20.945834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:20.946340 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:20.947120 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:20.947551 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:21.087412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:21.096100 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a909c966-3a06-469d-b812-2ad7f2abb006 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.163292 Jul 05 10:18:21.096686 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 253/512] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:20 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:22.114476 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:22.115167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:22.121540 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:22.122003 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:22.122899 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:22.123331 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:22.254187 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:22.264612 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a88ae2f0-37ce-4b5a-9975-bd1f3e51833c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.154926 Jul 05 10:18:22.265451 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 260/513] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:22 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:23.283322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:23.284157 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:23.288025 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:23.293535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:23.294374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:23.295559 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:23.296285 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:23.432146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:23.439829 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aeab773f-c755-4351-8f43-83151ca6a94c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.161057 Jul 05 10:18:23.441418 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 254/514] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:23 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:24.457845 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:24.458473 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:24.465135 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:24.465576 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:24.466518 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:24.466953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:24.603025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:24.610622 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c6e891b7-95ed-4d2f-9aab-47cd29652ab4 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.156891 Jul 05 10:18:24.611178 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 261/515] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:24 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:25.630111 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:25.630798 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:25.633206 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:25.639807 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:25.640379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:25.641378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:25.641974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:25.791622 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:25.801976 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a0dfea9e-6fe4-4532-ab87-08daeeb132e3 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.177016 Jul 05 10:18:25.802783 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 255/516] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:25 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:26.818677 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:26.819280 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:26.821294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:26.821933 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:18:26.828155 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:26.828329 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-edbf7438-5045-4c54-a2f0-bceb2782e458 req-dba08ff8-c90c-4289-8ef4-d9ec4b64af29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7601d2a5-817c-4e1c-b38c-6fae04f45c03", "name": "network-vif-plugged", "status": "completed", "tag": "0464b48e-8cb3-4e38-a628-d78665810656"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:26.828794 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:26.829415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:26.829841 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:26.836821 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-edbf7438-5045-4c54-a2f0-bceb2782e458 req-dba08ff8-c90c-4289-8ef4-d9ec4b64af29 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:26.837322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-edbf7438-5045-4c54-a2f0-bceb2782e458 req-dba08ff8-c90c-4289-8ef4-d9ec4b64af29 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:26.849356 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-edbf7438-5045-4c54-a2f0-bceb2782e458 req-dba08ff8-c90c-4289-8ef4-d9ec4b64af29 service nova] Creating event network-vif-plugged:0464b48e-8cb3-4e38-a628-d78665810656 for instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 on hv-cinder-maste Jul 05 10:18:26.854465 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-edbf7438-5045-4c54-a2f0-bceb2782e458 req-dba08ff8-c90c-4289-8ef4-d9ec4b64af29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Jul 05 10:18:26.855087 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 256/517] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:26.966465 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:26.974456 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1731d575-ccbf-4d57-9aa2-c5847369a445 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.159539 Jul 05 10:18:26.975046 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 262/518] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:26 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:27.997172 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:27.998361 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:28.009704 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:28.010494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:28.011800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:28.012516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:28.147412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:28.155083 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-401cbad3-bbd8-4cf6-83a6-1460ac854ee2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1366 microversion: 2.1 time: 0.166008 Jul 05 10:18:28.155655 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 257/519] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:27 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:29.172307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:29.172997 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:29.179699 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:29.180231 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:29.181062 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:29.181502 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:29.311873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:18:29.319881 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5e49f401-a394-46c9-ae5a-78135ff9a190 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1557 microversion: 2.1 time: 0.151591 Jul 05 10:18:29.320446 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 263/520] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:18:29 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:18:29.336139 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:18:29.336650 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:18:29.343513 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:29.343956 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:29.344710 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:29.345140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:29.430485 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5d2ec9d9-7bcd-455a-955d-baa784da7574 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097865 Jul 05 10:18:29.431444 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 258/521] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:18:29 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:18:30.374427 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-fcac990a-cee8-46cb-8346-586c88ca6cc0 req-d7d7180b-1fb3-4c64-8b9c-3de077ac40ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7601d2a5-817c-4e1c-b38c-6fae04f45c03", "tag": "0464b48e-8cb3-4e38-a628-d78665810656"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:18:30.382816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-fcac990a-cee8-46cb-8346-586c88ca6cc0 req-d7d7180b-1fb3-4c64-8b9c-3de077ac40ab service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:18:30.383325 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-fcac990a-cee8-46cb-8346-586c88ca6cc0 req-d7d7180b-1fb3-4c64-8b9c-3de077ac40ab service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:18:30.394994 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-fcac990a-cee8-46cb-8346-586c88ca6cc0 req-d7d7180b-1fb3-4c64-8b9c-3de077ac40ab service nova] Creating event network-changed:0464b48e-8cb3-4e38-a628-d78665810656 for instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 on hv-cinder-maste Jul 05 10:18:30.400033 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-fcac990a-cee8-46cb-8346-586c88ca6cc0 req-d7d7180b-1fb3-4c64-8b9c-3de077ac40ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029256 Jul 05 10:18:30.400816 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 264/522] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:19:01.341708 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=9 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:01.342379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=48 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:01.347103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:01.347585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:01.354414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:01.354854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:01.355621 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:01.356051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:01.379254 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6b52f8f9-9152-45f9-87c8-1c0aa33c475a tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/ips" status: 200 len: 149 microversion: 2.20 time: 0.039130 Jul 05 10:19:01.383488 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 259/523] 10.222.0.16 () {60 vars in 1288 bytes} [Tue Jul 5 10:19:01 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 05 10:19:03.231282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:03.231889 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:03.234144 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=35 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:03.234775 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:03.240985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:03.241443 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:03.242196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:03.242638 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:03.267632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lazy-loading 'flavor' on Instance uuid 550efb9a-0897-4e58-ab8d-19c267ac7787 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:19:03.533788 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-52e549ed-6633-4a72-8ba2-bcd045a74a4e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/action" status: 202 len: 0 microversion: 2.20 time: 0.306864 Jul 05 10:19:03.534439 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 265/524] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 5 10:19:03 2022] POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:19:03.543376 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:03.544006 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:03.551349 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:03.552015 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:03.553231 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:03.553808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:03.697270 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:03.705744 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:03.707289 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:03.708448 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be68bc40-be55-41d0-9058-54ff453f67ea tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.169204 Jul 05 10:19:03.709011 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 260/525] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:03 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:04.738320 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:04.739357 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:04.750120 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:04.750915 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:04.752167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:04.752773 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:04.885956 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:04.894077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:04.895606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:04.896835 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e12204e2-8bde-4137-b19b-3ea0e38fa14c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.165947 Jul 05 10:19:04.897392 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 266/526] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:04 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:05.920653 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:05.921678 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:05.930978 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:05.931428 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:05.932190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:05.932628 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:06.063626 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:06.080976 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:06.083454 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:06.085325 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-70913b6b-4eea-496f-b707-de2abb71d8e6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.171350 Jul 05 10:19:06.085888 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 261/527] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:05 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:07.112270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:07.112993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:07.119416 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:07.119859 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:07.120739 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:07.121171 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:07.308079 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:07.316547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:07.318038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:07.319208 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-afbd6ace-f295-4989-96d8-07a94c495129 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.211510 Jul 05 10:19:07.319766 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 267/528] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:07 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:08.337108 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:08.337826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:08.344761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:08.345203 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:08.345941 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:08.346401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:08.480582 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:08.488811 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:08.490343 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:08.491551 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2fe63a00-f32c-46a8-a596-1ce2b1eeb05b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.158471 Jul 05 10:19:08.492203 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 262/529] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:08 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:09.512340 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:09.513122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:09.522117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:09.522819 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:09.523748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:09.524183 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:09.665350 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:09.673759 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:09.675302 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:09.676674 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-33501f20-b99f-4c69-9cf3-6e48b51557a4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.169542 Jul 05 10:19:09.677265 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 268/530] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:09 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:10.697647 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:10.698235 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:10.709950 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:10.712093 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:10.712877 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:10.713672 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:10.856127 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:10.864374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:10.865888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:10.867108 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f4b52023-4e0a-4728-b826-3fc2f4cce3bc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.175375 Jul 05 10:19:10.867662 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 263/531] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:10 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:11.885384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:11.886115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:11.893182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:11.893723 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:11.894546 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:11.894980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:12.037200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:12.046406 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:12.047932 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:12.049126 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3225ce91-48a1-4a4a-967f-db582534fb49 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.167925 Jul 05 10:19:12.049737 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 269/532] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:11 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:13.072229 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:13.073072 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:13.084248 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:13.084996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:13.086287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:13.087032 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:13.231087 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:13.242642 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:13.244153 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:13.245318 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-41a97c0c-51d2-4919-aee8-5ae395db2c9e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.180065 Jul 05 10:19:13.245887 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 264/533] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:13 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:14.263455 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:14.264056 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:14.270689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:14.271103 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:14.271913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:14.272336 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:14.405334 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:14.414093 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:14.415688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:14.416869 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5e14d833-f11b-44bc-994d-14d93eb26a33 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.157413 Jul 05 10:19:14.417427 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 270/534] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:14 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:15.440002 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:15.440967 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:15.452047 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:15.452782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:15.454078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:15.454868 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:15.596630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:15.608792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:15.611233 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:15.612901 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a23bd593-32ab-49d2-93ed-bb7c059b41fb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.179600 Jul 05 10:19:15.613666 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 265/535] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:15 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:16.636172 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:16.637014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:16.645981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:16.646985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:16.648197 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:16.650983 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:16.786720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:16.795159 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:16.796643 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:16.797776 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-af258bda-f181-42d9-a843-8db339fbe6ca tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.167499 Jul 05 10:19:16.798362 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 271/536] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:16 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:17.817944 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:17.818558 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:17.825501 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:17.825944 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:17.826738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:17.827160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:17.961302 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:17.969922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:17.971453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:17.972608 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-762a00dc-09d8-4152-8f4f-a48fa1d6ce75 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.159038 Jul 05 10:19:17.973147 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 266/537] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:17 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:18.995083 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:18.995963 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:19.002453 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:19.002898 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:19.003982 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:19.004517 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:19.134721 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:19.142779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:19.144276 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:19.145426 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-be546179-e983-415c-b864-6ade3b0cb22b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.156881 Jul 05 10:19:19.145991 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 272/538] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:18 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:19.164942 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-a6cf8887-fb67-4330-b395-7b32143f6a39 req-e0940461-adbe-4bbc-b99a-8dc65e5c9a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "name": "network-vif-plugged", "status": "completed", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:19.173014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a6cf8887-fb67-4330-b395-7b32143f6a39 req-e0940461-adbe-4bbc-b99a-8dc65e5c9a60 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:19.173323 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a6cf8887-fb67-4330-b395-7b32143f6a39 req-e0940461-adbe-4bbc-b99a-8dc65e5c9a60 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:19.184574 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-a6cf8887-fb67-4330-b395-7b32143f6a39 req-e0940461-adbe-4bbc-b99a-8dc65e5c9a60 service nova] Creating event network-vif-plugged:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:19:19.189478 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-a6cf8887-fb67-4330-b395-7b32143f6a39 req-e0940461-adbe-4bbc-b99a-8dc65e5c9a60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028486 Jul 05 10:19:19.190067 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 267/539] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:19:20.168082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:20.168702 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:20.178437 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:20.179078 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:20.180156 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:20.180603 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:20.324928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:20.333568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:20.335127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:20.336287 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-87d7dd0e-dbb9-440f-9b18-7137e9c0cf0d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.174850 Jul 05 10:19:20.336835 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 273/540] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:20 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:21.359130 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:21.360042 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:21.370071 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:21.370612 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:21.371826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:21.372541 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:21.515274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:21.525164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:21.526724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:21.527952 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4b763d57-a875-4de2-bd85-15ae7f7f380d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1742 microversion: 2.20 time: 0.176371 Jul 05 10:19:21.528540 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 268/541] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:21 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:22.548196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:22.548798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:22.556212 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:22.556787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:22.557685 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:22.558182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:22.702873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:22.710989 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:22.712498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:22.714011 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3242141e-eaa5-4a4c-9be2-b50e100848bb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.170848 Jul 05 10:19:22.714954 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 274/542] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:22 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:23.732230 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:23.732962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:23.739991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:23.740714 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:23.741690 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:23.742254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:23.911510 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:23.921023 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:23.922834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:23.924212 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e32036a5-8903-4509-84e7-b0effb4a6e22 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.196151 Jul 05 10:19:23.925403 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 269/543] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:23 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:24.943907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:24.944549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:24.951868 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:24.952313 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:24.953110 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:24.953550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:25.114148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:25.122488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:25.123995 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:25.125150 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3e38b0aa-66a9-40f0-9580-cf5ff2874a96 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.185417 Jul 05 10:19:25.125902 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 275/544] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:24 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:26.144316 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:26.144940 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:26.151957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:26.152414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:26.153177 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:26.153578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:26.312487 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:26.324029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:26.325517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:26.328137 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a4278572-2d8c-458b-9225-9ea7847cb440 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.186521 Jul 05 10:19:26.340208 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 270/545] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:26 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:27.346940 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:27.348280 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:27.355974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:27.356627 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:27.357652 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:27.358074 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:27.505850 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:27.523113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:27.524674 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:27.525850 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3bbab22f-fee3-422b-ba7d-ee3a1256afc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.182967 Jul 05 10:19:27.526429 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 276/546] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:27 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:28.545930 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:28.546713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:28.554991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:28.555660 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:28.556698 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:28.557390 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:28.699446 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:28.707626 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:28.709116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:28.710292 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8d4c719c-6666-485c-9e8a-092ae09c3e2e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.169153 Jul 05 10:19:28.710914 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 271/547] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:28 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:29.729453 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:29.730870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:29.737309 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:29.737898 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:29.738797 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:29.739216 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:29.890811 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:29.899430 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:29.900962 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:29.902376 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-802598e4-51f5-493b-801a-22be80745fa2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.177248 Jul 05 10:19:29.913295 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 277/548] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:29 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:30.921305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:30.921877 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:30.929120 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:30.929612 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:30.930451 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:30.930893 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:31.066945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:31.075712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:31.077196 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:31.078613 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a71a54a3-a982-479e-92e4-40f8a7abd9e7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.161562 Jul 05 10:19:31.081177 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 272/549] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:30 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:32.101549 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:32.102408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:32.112765 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:32.113511 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:32.114821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:32.115532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:32.246596 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:32.254989 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:32.256483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:32.257628 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-47020c88-9995-4fc8-a3cc-8516baf6108d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1737 microversion: 2.20 time: 0.162624 Jul 05 10:19:32.258169 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 278/550] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:32 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:33.280074 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:33.281423 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:33.284969 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=29 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:33.290941 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:33.291369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:33.292189 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:33.292623 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:33.295695 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=79 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:33.423392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:33.432254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:33.433805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:33.435001 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-906aecab-e359-4cd5-b76f-ff6f1472d116 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1719 microversion: 2.20 time: 0.158954 Jul 05 10:19:33.435606 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 273/551] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:33 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:34.457613 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:34.459384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:34.462287 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=29 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:34.468238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:34.468682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:34.469439 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:34.469867 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:34.474259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:34.605260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:34.618192 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:34.620566 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:34.622472 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9c671b74-59af-4acc-a1dd-0823ff4b32a3 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1719 microversion: 2.20 time: 0.171684 Jul 05 10:19:34.623279 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 279/552] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:34 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:35.644964 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:35.645782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:35.655292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:35.655738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:35.656507 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:35.656939 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:35.804816 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:35.813425 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:35.814974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:35.816124 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0c66f54b-ca2b-4ef5-869d-90b0bfd12cb7 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1662 microversion: 2.20 time: 0.177489 Jul 05 10:19:35.816706 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 274/553] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:35 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1662 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:35.840088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b0b4ce-9106-4ea3-a406-ab4e49022f11"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:35.841185 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:35.849907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:35.850400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:35.851166 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:35.851602 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.156619 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4b3495b5-8187-4836-b451-e85cc5dc8f14 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.320938 Jul 05 10:19:36.157158 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 280/554] 10.222.0.16 () {62 vars in 1363 bytes} [Tue Jul 5 10:19:35 2022] POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 05 10:19:36.275127 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:36.275789 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:36.286246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.287154 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.288694 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.289368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.555030 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ce0f18af-dd79-4c74-b616-d0951b259238 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments/75b0b4ce-9106-4ea3-a406-ab4e49022f11" status: 202 len: 0 microversion: 2.20 time: 0.285999 Jul 05 10:19:36.555858 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 275/555] 10.222.0.16 () {60 vars in 1456 bytes} [Tue Jul 5 10:19:36 2022] DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments/75b0b4ce-9106-4ea3-a406-ab4e49022f11 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:19:36.613232 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:36.613779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:36.620203 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.620633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.621383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.621808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.701079 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-66b2a66e-6df3-4ee2-b7df-01c7cf580659 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/action" status: 202 len: 0 microversion: 2.20 time: 0.091724 Jul 05 10:19:36.701609 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 281/556] 10.222.0.16 () {62 vars in 1318 bytes} [Tue Jul 5 10:19:36 2022] POST /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:19:36.709753 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:36.710996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:36.717826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.718301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.719069 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:36.719494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:36.849058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:36.857224 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:36.858757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:36.859907 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5dbf18e3-fcfc-400c-ac8b-20eaa97c60b1 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1670 microversion: 2.20 time: 0.154110 Jul 05 10:19:36.860463 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 276/557] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:36 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:37.253014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-a3a19e65-30d5-4bf0-a6e8-b7a4015c410a req-639ab17c-7e70-4599-91dd-17135a46a0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "name": "network-vif-unplugged", "status": "completed", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:37.262290 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a3a19e65-30d5-4bf0-a6e8-b7a4015c410a req-639ab17c-7e70-4599-91dd-17135a46a0b1 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:37.262991 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-a3a19e65-30d5-4bf0-a6e8-b7a4015c410a req-639ab17c-7e70-4599-91dd-17135a46a0b1 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:37.275041 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.compute.server_external_events [req-a3a19e65-30d5-4bf0-a6e8-b7a4015c410a req-639ab17c-7e70-4599-91dd-17135a46a0b1 service nova] Unable to find a host for instance 550efb9a-0897-4e58-ab8d-19c267ac7787. Dropping event network-vif-unplugged {{(pid=117864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 05 10:19:37.276020 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-a3a19e65-30d5-4bf0-a6e8-b7a4015c410a req-639ab17c-7e70-4599-91dd-17135a46a0b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026966 Jul 05 10:19:37.276798 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 282/558] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 05 10:19:37.880707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:37.881330 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:37.888412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:37.888861 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:37.889629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:37.890064 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:38.025713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:38.034102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:38.035644 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:38.036813 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e4002d12-b449-4da0-916a-ea5fa8f02d0c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.160146 Jul 05 10:19:38.037397 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 277/559] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:37 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:39.057219 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:39.058778 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:39.066773 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:39.067688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:39.068844 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:39.069623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:39.216348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:39.225507 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:39.227311 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:39.228657 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-4ca0cf1c-f261-49af-bf65-30ecb5baf882 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.176273 Jul 05 10:19:39.229450 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 283/560] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:39 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:40.249603 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:40.250511 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:40.261357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:40.262104 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:40.263439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:40.264160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:40.425884 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:40.434316 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:40.435834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:40.437005 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b4c2a119-d50d-4139-9bc3-c1be129a9dfc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.193643 Jul 05 10:19:40.437573 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 278/561] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:40 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:41.456369 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:41.456906 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:41.463573 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:41.464061 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:41.464798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:41.465224 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:41.621239 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:41.629912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:41.631719 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:41.632834 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9912bff7-0252-4de5-8481-431d6809da51 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.180605 Jul 05 10:19:41.633594 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 284/562] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:41 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:42.657123 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:42.658199 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:42.668048 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:42.668793 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:42.670040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:42.670794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:42.812716 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:42.820853 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:42.822372 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:42.823516 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d2caeb10-d2d1-421a-9b63-a446a8154ead tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.174373 Jul 05 10:19:42.824076 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 279/563] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:42 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:43.843832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:43.844824 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:43.855070 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:43.855866 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:43.857295 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:43.857398 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:43.988780 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:43.996731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:43.998211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:43.999367 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-26b89e3d-99c9-4dab-9997-08b28d016cc2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.161230 Jul 05 10:19:43.999958 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 285/564] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:43 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:45.018348 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:45.018996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:45.026038 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:45.026516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:45.027282 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:45.027712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:45.178104 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:45.186045 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:45.187562 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:45.188767 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4c452ca3-6fc9-4e4a-9b9a-0467e4f78393 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.174620 Jul 05 10:19:45.189326 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 280/565] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:45 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:45.800859 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:45.801357 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:45.807502 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:45.807938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:45.808678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:45.809133 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:45.832077 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-927f8859-e554-4ab5-90e0-e2515f1b21d2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/ips" status: 200 len: 151 microversion: 2.1 time: 0.147571 Jul 05 10:19:45.832615 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 286/566] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:19:45 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/ips => generated 151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:19:46.216056 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:46.217384 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:46.225046 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:46.228909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:46.228909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:46.228909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:46.392393 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:46.401574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:46.403504 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:46.404725 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-713c5398-be42-4a43-9a3c-eb6503696046 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.195075 Jul 05 10:19:46.405789 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 281/567] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:46 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:47.191165 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46d88b9-af5e-43dd-9faf-b4891a38376a"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:47.192273 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:47.198514 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:47.198957 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:47.199710 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:47.200146 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:47.424625 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:47.425288 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:47.431860 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:47.432301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:47.433055 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:47.433510 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:47.572638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:47.581122 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:47.582652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:47.583971 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d2a13e1a-1818-4cdb-b77f-f42006e11dfd tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.163540 Jul 05 10:19:47.592273 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 282/568] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:47 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:48.604775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:48.605512 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:48.612234 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:48.612679 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:48.613437 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:48.613870 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:48.758058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:48.766528 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:48.768134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:48.769338 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-939055df-a8c9-4097-bc92-1dca865432a6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.169690 Jul 05 10:19:48.769918 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 283/569] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:48 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:49.788529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:49.789143 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:49.796193 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:49.796643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:49.797395 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:49.797826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:49.929900 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:49.938000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:49.939529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:49.940668 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a13b9e0c-85d0-458d-bc93-8afbe6e8dff4 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.156218 Jul 05 10:19:49.941204 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 284/570] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:49 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:50.964036 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:50.965091 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:50.975817 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:50.976542 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:50.977779 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:50.978554 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:51.120296 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:51.132349 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:51.134676 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:51.136412 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7e3c7991-3f60-48b9-b6bc-2449944f9143 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.179500 Jul 05 10:19:51.137202 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 285/571] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:50 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:52.161411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:52.162337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:52.173337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:52.174047 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:52.175323 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:52.175984 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:52.322606 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:52.333446 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:52.336207 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:52.337792 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9c0745dc-69f5-4db7-85df-2252a29ad30b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.183411 Jul 05 10:19:52.338709 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 286/572] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:52 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:53.362414 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:53.363219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:53.371283 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:53.371806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:53.372688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:53.373202 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:53.377895 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:53.515122 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:53.523753 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:53.525265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:53.526474 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-73e7369f-1d31-4852-b15d-c013f2f5476c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.170156 Jul 05 10:19:53.527022 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 287/573] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:53 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:54.547684 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:54.548385 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:54.555339 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:54.555940 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:54.556563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:54.557233 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:54.611166 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9641e801-8c07-4448-8225-50ac491e5810 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.423880 Jul 05 10:19:54.611895 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 287/574] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:19:47 2022] POST /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments => generated 194 bytes in 7426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:19:54.693597 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:54.701903 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:54.703497 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:54.704824 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-03460f95-20d2-48c5-8dfc-2bdbae8318cc tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.161167 Jul 05 10:19:54.705381 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 288/575] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:54 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:55.725568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:55.726253 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:55.733210 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:55.733758 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:55.734877 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:55.735488 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:55.891366 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:55.901087 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:55.902745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:55.904245 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2a9a721c-da54-44a4-bb08-8371cc9b9b19 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.183776 Jul 05 10:19:55.904921 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 288/576] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:55 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:56.868711 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46d88b9-af5e-43dd-9faf-b4891a38376a"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:56.869870 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:56.876962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:56.877416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:56.878186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:56.878660 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:56.923022 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:56.923703 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:56.930814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:56.931301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:56.932139 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:56.932656 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:56.961352 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: POST /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments HTTP/1.1 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 74 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:19:56.963648 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: {"volumeAttachment": {"volumeId": "b46d88b9-af5e-43dd-9faf-b4891a38376a"}} Jul 05 10:19:56.965056 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'server_id': '7601d2a5-817c-4e1c-b38c-6fae04f45c03', 'body': {'volumeAttachment': {'volumeId': 'b46d88b9-af5e-43dd-9faf-b4891a38376a'}}} Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:19:56.965807 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:19:56.967075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 400 to user: Invalid volume: volume b46d88b9-af5e-43dd-9faf-b4891a38376a is already attached to instances: 7601d2a5-817c-4e1c-b38c-6fae04f45c03 {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6732ac50-c91e-494e-b885-3010ddb35fb2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100530 Jul 05 10:19:56.968324 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 289/577] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:19:56 2022] POST /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:19:57.028030 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:57.028534 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:57.034763 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:57.035208 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:57.035988 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:57.036440 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:57.065009 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:57.073109 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:57.074623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:57.075771 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-46a2cd00-87c5-499e-a76f-492281147eb2 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.156672 Jul 05 10:19:57.076326 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 289/578] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:56 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 05 10:19:57.116305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lazy-loading 'services' on Instance uuid 7601d2a5-817c-4e1c-b38c-6fae04f45c03 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:19:57.197128 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c455423d-9a86-4b78-87fe-b0a9d005ae87 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments/b46d88b9-af5e-43dd-9faf-b4891a38376a" status: 202 len: 0 microversion: 2.1 time: 0.172808 Jul 05 10:19:57.197734 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 290/579] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:19:57 2022] DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments/b46d88b9-af5e-43dd-9faf-b4891a38376a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:19:57.206260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:57.207441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:57.214019 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:57.214569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:57.215267 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:57.215688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:57.245248 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3dfb850b-53df-4c88-8b87-de15adb2bfd2 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Jul 05 10:19:57.245782 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 290/580] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:19:57 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:19:57.384276 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f0cf6585-b6fe-4a50-975a-d719affd3fbd req-f0301207-cdc2-4d6f-96e2-69bfe2fe27f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "name": "network-vif-plugged", "status": "completed", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:19:57.392905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f0cf6585-b6fe-4a50-975a-d719affd3fbd req-f0301207-cdc2-4d6f-96e2-69bfe2fe27f6 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:57.393351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f0cf6585-b6fe-4a50-975a-d719affd3fbd req-f0301207-cdc2-4d6f-96e2-69bfe2fe27f6 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:57.405231 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f0cf6585-b6fe-4a50-975a-d719affd3fbd req-f0301207-cdc2-4d6f-96e2-69bfe2fe27f6 service nova] Creating event network-vif-plugged:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:19:57.410094 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f0cf6585-b6fe-4a50-975a-d719affd3fbd req-f0301207-cdc2-4d6f-96e2-69bfe2fe27f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Jul 05 10:19:57.410767 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 291/581] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:19:58.094954 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:58.095623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:58.102602 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.103048 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.103816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.104255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.235304 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:58.238180 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:19:58.245834 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:58.247384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:58.248583 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-326c028b-91cf-4c52-81a3-caa4eaff7064 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.157858 Jul 05 10:19:58.249155 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 291/582] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:58 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:58.258505 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:58.259599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:58.265896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.266382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.267140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.267571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.296388 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8a695529-7b20-4ed3-9cdd-633f155fb0da tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042705 Jul 05 10:19:58.296864 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 292/583] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:19:58 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:19:58.357928 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:58.358450 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:58.366000 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.366494 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.367242 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.367678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.394254 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:19:58.478004 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fb81d4bd-8e51-430c-8c21-b7dd26dfb147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 204 len: 0 microversion: 2.1 time: 0.123830 Jul 05 10:19:58.478587 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 292/584] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:19:58 2022] DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:19:58.487002 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:58.487624 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:58.493683 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.494146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.494942 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:58.495400 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:58.627778 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:58.639114 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-74081c8f-61ba-430a-9d4c-0bb3da8860ce tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1682 microversion: 2.1 time: 0.155931 Jul 05 10:19:58.640014 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 293/585] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:19:58 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:19:59.267228 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:59.268017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:59.274937 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:59.275454 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:59.276264 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:59.276688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:59.510788 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:59.520194 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:59.522036 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:19:59.523231 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0b12ecdd-c748-450d-8a4e-8ea6a50720c8 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.260841 Jul 05 10:19:59.523801 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 293/586] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:19:59 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:19:59.659405 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:19:59.659967 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:19:59.666779 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:59.667234 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:19:59.667994 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:19:59.668442 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.129911 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:00.140828 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-89fd8cf1-e555-4243-8801-626a8df7e4fc tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1682 microversion: 2.1 time: 0.485530 Jul 05 10:20:00.142047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:00.142633 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:00.149167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.149686 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.150708 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.150823 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 294/587] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:19:59 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1682 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:00.151109 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.155515 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-ec338d70-e1df-46ef-9e7f-cf23eadfa226 req-025e6fb8-2dde-4800-a8d1-e91b15404a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:00.163724 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-ec338d70-e1df-46ef-9e7f-cf23eadfa226 req-025e6fb8-2dde-4800-a8d1-e91b15404a1b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.164162 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-ec338d70-e1df-46ef-9e7f-cf23eadfa226 req-025e6fb8-2dde-4800-a8d1-e91b15404a1b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.177279 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-ec338d70-e1df-46ef-9e7f-cf23eadfa226 req-025e6fb8-2dde-4800-a8d1-e91b15404a1b service nova] Creating event network-changed:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:20:00.177550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:20:00.182522 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-ec338d70-e1df-46ef-9e7f-cf23eadfa226 req-025e6fb8-2dde-4800-a8d1-e91b15404a1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030404 Jul 05 10:20:00.182908 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 295/588] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:00.256686 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-696ad1bd-f6d3-476f-97ce-7239ca6388cc tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "DELETE /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 204 len: 0 microversion: 2.1 time: 0.118596 Jul 05 10:20:00.257280 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 294/589] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:20:00 2022] DELETE /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 05 10:20:00.266191 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:00.267201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:00.273647 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.274101 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.274939 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.275374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.407353 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:00.415193 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-804aca8e-92c5-4373-98d0-ab919b422d2d tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.153283 Jul 05 10:20:00.415740 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 296/590] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:00 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:00.543781 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:00.544373 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:00.552127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.552800 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.553986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:00.554441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:00.691324 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:00.700080 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:00.701596 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:00.702802 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1e3f4e1e-2d1a-4e59-a2b9-27a31095fdd6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.165190 Jul 05 10:20:00.703364 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 295/591] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:20:00 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:20:01.158488 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:01.159058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:01.166013 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.166496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.167256 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.167688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.295029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:01.302793 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-415cfdb7-25af-49f1-a3d3-52ef9aa05dd5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1682 microversion: 2.1 time: 0.148391 Jul 05 10:20:01.303367 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 297/592] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:01 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:01.436627 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:01.437490 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:01.447900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.448658 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.449914 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.450697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.598298 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:01.609443 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74366dc1-1cd2-40f1-9d8d-e3280072e89a tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.179138 Jul 05 10:20:01.610208 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 296/593] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:01 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:01.725835 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:01.726757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:01.737050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.737791 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.739086 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:01.739799 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:01.871689 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:01.881767 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:01.883323 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:01.884503 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-606857dd-b3b6-411a-b903-163f455527d6 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1728 microversion: 2.20 time: 0.165524 Jul 05 10:20:01.885068 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 298/594] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:20:01 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:20:02.320444 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:02.321066 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:02.327878 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.328348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:02.329145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.329630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:02.470518 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:02.482672 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b7d44501-a7a9-4daf-9a60-7d7840808aeb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1682 microversion: 2.1 time: 0.165993 Jul 05 10:20:02.483435 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 297/595] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:02 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:02.627525 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:02.628059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:02.635001 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.635457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:02.636215 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.636645 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:02.782117 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:02.790395 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b531a5d3-1b23-4cd1-8371-27fcad2803eb tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1567 microversion: 2.1 time: 0.166974 Jul 05 10:20:02.790974 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 299/596] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:02 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:02.903470 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:02.904012 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:02.910925 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.911364 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:02.912120 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:02.912540 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.117483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:03.126157 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:03.127947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:03.129483 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b8ebe42e-bb3b-49a6-af89-5062f2bdb14d tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1715 microversion: 2.20 time: 0.229982 Jul 05 10:20:03.130214 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 298/597] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:20:02 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1715 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:20:03.349761 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-91cd14a4-9fda-4e9c-85e0-36b0b825ae4b req-766e4622-e917-440d-81e0-c41fb55dd0dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc74bf2-53b0-450e-a3d1-663ad51af48d", "name": "network-vif-deleted", "tag": "e6ee874e-5b67-4729-b750-5c04ff47d508"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:03.353585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=54 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:03.359805 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-91cd14a4-9fda-4e9c-85e0-36b0b825ae4b req-766e4622-e917-440d-81e0-c41fb55dd0dc service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.360241 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-91cd14a4-9fda-4e9c-85e0-36b0b825ae4b req-766e4622-e917-440d-81e0-c41fb55dd0dc service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.373201 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-91cd14a4-9fda-4e9c-85e0-36b0b825ae4b req-766e4622-e917-440d-81e0-c41fb55dd0dc service nova] Creating event network-vif-deleted:e6ee874e-5b67-4729-b750-5c04ff47d508 for instance edc74bf2-53b0-450e-a3d1-663ad51af48d on hv-cinder-maste Jul 05 10:20:03.378316 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-91cd14a4-9fda-4e9c-85e0-36b0b825ae4b req-766e4622-e917-440d-81e0-c41fb55dd0dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Jul 05 10:20:03.379283 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 300/598] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:03.505214 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:03.506114 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:03.514424 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.515826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.517252 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.518970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.595260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:03.603089 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c67cb7e-c4e9-4e77-8ea9-ef12077e8be8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 200 len: 1615 microversion: 2.1 time: 0.101870 Jul 05 10:20:03.603856 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 299/599] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:03 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 1615 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:03.809347 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:03.810107 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:03.825096 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.825545 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.826358 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.826794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.871215 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9194276a-99b5-418c-bec4-83c53fce76c8 req-bd8b57df-f4fb-4d4f-84ce-4abad3a25401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7601d2a5-817c-4e1c-b38c-6fae04f45c03", "name": "network-vif-deleted", "tag": "0464b48e-8cb3-4e38-a628-d78665810656"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:03.882734 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9194276a-99b5-418c-bec4-83c53fce76c8 req-bd8b57df-f4fb-4d4f-84ce-4abad3a25401 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.883096 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9194276a-99b5-418c-bec4-83c53fce76c8 req-bd8b57df-f4fb-4d4f-84ce-4abad3a25401 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.889751 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:03.890457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:03.891056 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lazy-loading 'fault' on Instance uuid edc74bf2-53b0-450e-a3d1-663ad51af48d {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:20:03.899252 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9194276a-99b5-418c-bec4-83c53fce76c8 req-bd8b57df-f4fb-4d4f-84ce-4abad3a25401 service nova] Creating event network-vif-deleted:0464b48e-8cb3-4e38-a628-d78665810656 for instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 on hv-cinder-maste Jul 05 10:20:03.905159 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9194276a-99b5-418c-bec4-83c53fce76c8 req-bd8b57df-f4fb-4d4f-84ce-4abad3a25401 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037446 Jul 05 10:20:03.906920 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 300/600] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:03.945961 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9966a96281b745e684d0cd16bb470e6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '815e83f886cc4c78bcdc31eb4230c782', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:03.953657 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9da76bbe-1b3e-4242-8222-452ddee2f6ef tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 200 len: 1387 microversion: 2.1 time: 0.149861 Jul 05 10:20:03.961342 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:03 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 1387 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:04.621569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:04.622337 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:04.624864 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:04.631532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:04.631970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:04.632742 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:04.633166 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:04.653277 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 HTTP/1.1 Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:20:04.657251 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:20:04.658883 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '7601d2a5-817c-4e1c-b38c-6fae04f45c03'} Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:20:04.659784 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:20:04.661596 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:04.662761 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:20:04.662761 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fe3cd758-da91-4b37-a750-692b5a0170e7 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 404 len: 111 microversion: 2.1 time: 0.041763 Jul 05 10:20:04.662761 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 301/602] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:04 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:20:04.668996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-084812b3-ce0b-492d-9892-697041a8b4b5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '.version_select at 0x7ffbf00cdc10>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:04.687326 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-084812b3-ce0b-492d-9892-697041a8b4b5 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-985116597" status: 202 len: 0 microversion: 2.1 time: 0.022418 Jul 05 10:20:04.687920 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 302/603] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jul 5 10:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-985116597 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:20:04.978874 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:04.979483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] [instance: edc74bf2-53b0-450e-a3d1-663ad51af48d] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:04.985586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:04.986028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:04.986815 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:04.987230 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:05.002400 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] HTTP exception thrown: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Request method failure captured: Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d HTTP/1.1 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7t21ujETIPlp8JYTqQWY70aIFB18PspvGJbjRHe8e1VjSSL4TdOfHbBIznNdoyDIjEtD4IgdB2Y4ezwYTYo4qrRuLY7X9hyN-h5Rkgq86OL9M6lMvg2ILAQ-iRE17LL-NJlGd4TL096orhutgMzDBhxnN8HctEDxzyCJQVZu3hIxk Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 815e83f886cc4c78bcdc31eb4230c782 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-TestShelveInstance-77257171 Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:20:05.003945 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_815e83f886cc4c78bcdc31eb4230c782"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/815e83f886cc4c78bcdc31eb4230c782"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/815e83f886cc4c78bcdc31eb4230c782"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/815e83f886cc4c78bcdc31eb4230c782"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-TestShelveInstance-77257171 Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 815e83f886cc4c78bcdc31eb4230c782 Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestShelveInstance-77257171 Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-TestShelveInstance-77257171-project Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 9966a96281b745e684d0cd16bb470e6a Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-TestShelveInstance-77257171-project Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. Jul 05 10:20:05.006814 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': 'edc74bf2-53b0-450e-a3d1-663ad51af48d'} Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:20:05.008239 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. Jul 05 10:20:05.010628 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:20:05.013067 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Returning 404 to user: Instance edc74bf2-53b0-450e-a3d1-663ad51af48d could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:20:05.013067 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7a3abe28-63d1-4dac-abbc-c03ea66cc286 tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jul 05 10:20:05.013067 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 302/604] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:04 2022] GET /compute/v2.1/servers/edc74bf2-53b0-450e-a3d1-663ad51af48d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:20:05.184146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8da39f77-1a74-4c4f-9e69-27a8aaf62ece tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] Calling method '.version_select at 0x7ffbf00fe8b0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:05.206549 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8da39f77-1a74-4c4f-9e69-27a8aaf62ece tempest-TestShelveInstance-77257171 tempest-TestShelveInstance-77257171-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-587742471" status: 202 len: 0 microversion: 2.1 time: 0.027392 Jul 05 10:20:05.207530 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 303/605] 10.222.0.16 () {58 vars in 1250 bytes} [Tue Jul 5 10:20:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-587742471 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:20:05.330790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c5e6e38-e63a-4f57-bce7-4eae77ddf6af tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: .version_select at 0x7ffbf01475e0>, body: {"keypair": {"name": "tempest-keypair-1805733162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGA00/mQGbOBOkNGInfZ5Dmksq82+u77r7bTZXWa3I031b1Mx8PC1JgTe7TSN6+twe0FzY/TGL08hvFbbK0dNF5/LZlctiA8N0xUtydMpKGMyg2gwMTt6WuhGEqYnYUt5A=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:05.349663 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-6c5e6e38-e63a-4f57-bce7-4eae77ddf6af tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:20:05.353810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-6c5e6e38-e63a-4f57-bce7-4eae77ddf6af tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:20:05.379370 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c5e6e38-e63a-4f57-bce7-4eae77ddf6af tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052728 Jul 05 10:20:05.380043 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 303/606] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:20:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:06.908911 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-922750681", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c98b9981-e889-405e-93b5-a13b417620de"}], "security_groups": [{"name": "tempest-securitygroup--1083849197"}], "key_name": "tempest-keypair-1805733162", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:07.044953 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] validate_networks() for [('c98b9981-e889-405e-93b5-a13b417620de', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:20:08.043879 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:20:08.044417 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:20:08.044901 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:20:08.045369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:20:08.045841 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:20:08.055846 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:08.056289 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:08.057082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:08.057627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:08.075395 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:20:08.079399 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Getting quotas for user ae9cd6d6d5824aa1932d3353578285af and project 96cc7b005126403f94110029f4242a9f. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:20:08.090854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:20:08.093113 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:20:08.143597 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-10be570c-836d-4b51-87dd-9085ee6c3283 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.239370 Jul 05 10:20:08.144732 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 304/607] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:20:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:20:08.155419 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-58afe65a-185c-4885-9a30-cdc2b284a733 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:08.157383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-58afe65a-185c-4885-9a30-cdc2b284a733 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:08.227175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-58afe65a-185c-4885-9a30-cdc2b284a733 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:08.239069 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-58afe65a-185c-4885-9a30-cdc2b284a733 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1241 microversion: 2.1 time: 0.088043 Jul 05 10:20:08.245411 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 304/608] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:08 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:20:09.257080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:09.258401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:09.264870 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:09.265944 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:09.266830 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:09.267271 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:09.336364 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:09.344972 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0f9f000c-a716-4393-8780-e2df35bf670c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1311 microversion: 2.1 time: 0.092366 Jul 05 10:20:09.345549 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 305/609] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:09 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:10.363222 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:10.363808 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:10.372140 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:10.372745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:10.373629 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:10.374187 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:10.529014 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:10.539041 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b934918e-dd93-4275-8e26-6fa6c63d1d44 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.179023 Jul 05 10:20:10.540530 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 305/610] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:10 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:11.557985 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:11.561029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:11.572529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:11.573212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:11.574297 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:11.574955 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:11.846244 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:11.855643 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d2fdbb3b-1f6a-46e6-9b70-a3c37bbceb4e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.301104 Jul 05 10:20:11.865980 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 306/611] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:11 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:11.892124 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-839b2218-516b-42de-ab73-d48dacacdc8c req-2cc820f4-d987-44d3-b794-46c41810d219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133a6605-7651-497a-b49a-b87fe8789a4a", "tag": "74c6a5ec-7e14-46cd-bebf-6587eeafc55b"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:11.905619 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-839b2218-516b-42de-ab73-d48dacacdc8c req-2cc820f4-d987-44d3-b794-46c41810d219 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:11.906061 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-839b2218-516b-42de-ab73-d48dacacdc8c req-2cc820f4-d987-44d3-b794-46c41810d219 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:11.934248 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-839b2218-516b-42de-ab73-d48dacacdc8c req-2cc820f4-d987-44d3-b794-46c41810d219 service nova] Creating event network-changed:74c6a5ec-7e14-46cd-bebf-6587eeafc55b for instance 133a6605-7651-497a-b49a-b87fe8789a4a on hv-cinder-maste Jul 05 10:20:11.940062 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-839b2218-516b-42de-ab73-d48dacacdc8c req-2cc820f4-d987-44d3-b794-46c41810d219 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052371 Jul 05 10:20:11.941297 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 306/612] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:12.873279 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:12.874584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:12.882363 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:12.883130 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:12.884192 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:12.885558 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:12.915772 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:13.045299 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:13.054503 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-35499d39-a4c6-493c-a20c-bce17dee7147 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.185661 Jul 05 10:20:13.064158 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 307/613] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:12 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:14.072196 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:14.073722 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:14.080690 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:14.081142 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:14.081859 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:14.082351 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:14.219279 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:14.227701 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0ee880a5-08d5-462f-9d9d-932c09ddeb8e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.159688 Jul 05 10:20:14.228319 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 307/614] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:14 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:15.248788 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:15.249741 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:15.257326 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:15.257778 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:15.258635 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:15.259100 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:15.408768 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:15.416444 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6f844be0-d3bf-45bf-bef6-9f6b282d49c1 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.174186 Jul 05 10:20:15.416997 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 308/615] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:15 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:16.437048 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:16.438057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:16.448716 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:16.449463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:16.450811 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:16.451561 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:16.598011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:16.609702 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f35b8b85-dfc9-4a7c-a963-cc6d6eb0a9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.178775 Jul 05 10:20:16.610756 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 308/616] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:16 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:17.509516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f087012d-fa1d-41a6-b562-1909c6a608c0 req-1f8b7fd9-c047-4f5d-85ef-84dd556d3812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133a6605-7651-497a-b49a-b87fe8789a4a", "name": "network-vif-plugged", "status": "completed", "tag": "74c6a5ec-7e14-46cd-bebf-6587eeafc55b"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:17.519560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f087012d-fa1d-41a6-b562-1909c6a608c0 req-1f8b7fd9-c047-4f5d-85ef-84dd556d3812 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:17.520014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f087012d-fa1d-41a6-b562-1909c6a608c0 req-1f8b7fd9-c047-4f5d-85ef-84dd556d3812 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:17.530908 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f087012d-fa1d-41a6-b562-1909c6a608c0 req-1f8b7fd9-c047-4f5d-85ef-84dd556d3812 service nova] Creating event network-vif-plugged:74c6a5ec-7e14-46cd-bebf-6587eeafc55b for instance 133a6605-7651-497a-b49a-b87fe8789a4a on hv-cinder-maste Jul 05 10:20:17.535935 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f087012d-fa1d-41a6-b562-1909c6a608c0 req-1f8b7fd9-c047-4f5d-85ef-84dd556d3812 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Jul 05 10:20:17.536522 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 309/617] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:17.626902 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:17.627483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:17.633995 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:17.634480 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:17.635246 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:17.635675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:17.770780 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:17.773312 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:17.781325 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-30448735-0d0f-4f86-a7f0-1d444e807292 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.158377 Jul 05 10:20:17.782154 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 309/618] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:17 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:18.796122 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:18.796820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:18.801884 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:18.802598 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:18.809608 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:18.810045 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:18.810840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:18.811265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:18.955334 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:18.963466 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a8022b27-cb52-4b01-ad6e-0ef8c50e816e tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1367 microversion: 2.1 time: 0.168054 Jul 05 10:20:18.964038 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 310/619] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:18 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:19.984648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:19.985678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:19.989313 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:20.001434 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:20.001884 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:20.002871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:20.003298 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:20.134837 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:20.142950 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3a724725-9b43-4f3c-b062-5669c8aab9de tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1558 microversion: 2.1 time: 0.165112 Jul 05 10:20:20.143646 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 310/620] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:20:19 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:20.165387 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:20.165984 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:20.172561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:20.173070 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:20.173815 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:20.174274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:20.257664 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-72e06fc6-2836-4bd2-8a8f-5ce360de157b tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096357 Jul 05 10:20:20.258603 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 311/621] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:20:20 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:21.502392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-0efc394b-c88b-41c2-8380-b57dd166e873 req-a1149ca8-fd8d-4a10-b60d-156f2d8de1cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133a6605-7651-497a-b49a-b87fe8789a4a", "tag": "74c6a5ec-7e14-46cd-bebf-6587eeafc55b"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:20:21.511326 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0efc394b-c88b-41c2-8380-b57dd166e873 req-a1149ca8-fd8d-4a10-b60d-156f2d8de1cd service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:21.511774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-0efc394b-c88b-41c2-8380-b57dd166e873 req-a1149ca8-fd8d-4a10-b60d-156f2d8de1cd service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:21.522645 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-0efc394b-c88b-41c2-8380-b57dd166e873 req-a1149ca8-fd8d-4a10-b60d-156f2d8de1cd service nova] Creating event network-changed:74c6a5ec-7e14-46cd-bebf-6587eeafc55b for instance 133a6605-7651-497a-b49a-b87fe8789a4a on hv-cinder-maste Jul 05 10:20:21.527587 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-0efc394b-c88b-41c2-8380-b57dd166e873 req-a1149ca8-fd8d-4a10-b60d-156f2d8de1cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028962 Jul 05 10:20:21.528332 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 311/622] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:20:58.503305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:58.504101 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=20 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:58.508708 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:58.509695 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:58.517116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.517548 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.518352 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.518766 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.548819 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aacdeca3-2c00-44c4-90c5-f4bb80daefcb tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047191 Jul 05 10:20:58.549375 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 312/623] 10.222.0.16 () {60 vars in 1342 bytes} [Tue Jul 5 10:20:58 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:20:58.612255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:58.613102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=9 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:20:58.618835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:58.619695 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:58.628943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.629383 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.630148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.630605 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.665502 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:20:58.748443 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8965edd4-5ae2-46cf-8503-c52860889848 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 204 len: 0 microversion: 2.20 time: 0.138960 Jul 05 10:20:58.749043 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 312/624] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 5 10:20:58 2022] DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 10:20:58.759087 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:58.759666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:58.766340 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.766775 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.767539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:58.767965 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:58.908934 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:58.917932 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:58.919510 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:20:58.920721 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7af014c7-cbf8-408b-8d8d-f823197ab686 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.166231 Jul 05 10:20:58.921325 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 313/625] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:20:58 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:20:59.944747 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:20:59.945869 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:20:59.956768 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:59.957498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:20:59.958792 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:20:59.959499 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:00.091192 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:00.099411 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:00.100912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:00.102048 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6fc096c8-8318-47ad-8034-0da5faaf2c2c tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1721 microversion: 2.20 time: 0.164577 Jul 05 10:21:00.102635 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 313/626] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:20:59 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:21:01.121073 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:01.121767 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:01.127893 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:01.128339 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:01.129094 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:01.129529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:01.193535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:01.203254 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:01.205003 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e20b9a489342d2b8f0f85542ab370c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd343798527cf445295916cc8e8134bf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:01.206253 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3871cd48-df08-4626-96e0-b95655a8b693 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 200 len: 1653 microversion: 2.20 time: 0.089754 Jul 05 10:21:01.206902 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 314/627] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:21:01 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 1653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 05 10:21:01.254628 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-7c96508b-4e15-4017-8103-ea596a642d4d req-f35a0399-5936-4baa-8737-db553c41f517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550efb9a-0897-4e58-ab8d-19c267ac7787", "name": "network-vif-deleted", "tag": "f5302c51-8206-4ac9-a320-f681eb81769d"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:01.263875 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7c96508b-4e15-4017-8103-ea596a642d4d req-f35a0399-5936-4baa-8737-db553c41f517 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:01.264310 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7c96508b-4e15-4017-8103-ea596a642d4d req-f35a0399-5936-4baa-8737-db553c41f517 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:01.275782 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-7c96508b-4e15-4017-8103-ea596a642d4d req-f35a0399-5936-4baa-8737-db553c41f517 service nova] Creating event network-vif-deleted:f5302c51-8206-4ac9-a320-f681eb81769d for instance 550efb9a-0897-4e58-ab8d-19c267ac7787 on hv-cinder-maste Jul 05 10:21:01.280578 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-7c96508b-4e15-4017-8103-ea596a642d4d req-f35a0399-5936-4baa-8737-db553c41f517 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029747 Jul 05 10:21:01.281512 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 314/628] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:02.225529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:02.226119 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:02.233083 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:02.233531 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:02.234314 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:02.234757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:02.249234 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 HTTP/1.1 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:02.251089 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:02.252790 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '550efb9a-0897-4e58-ab8d-19c267ac7787'} Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:02.254466 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:02.255929 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:02.257325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:02.257325 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be146242-b1d5-4f8e-8208-3e44063f3627 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 404 len: 111 microversion: 2.20 time: 0.030960 Jul 05 10:21:02.257325 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 315/629] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:21:02 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:02.262200 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-16e69b93-fae9-4e09-809d-5d088eabfc16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '.version_select at 0x7ffbf0156ca0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:02.282101 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-16e69b93-fae9-4e09-809d-5d088eabfc16 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481047421" status: 204 len: 0 microversion: 2.20 time: 0.024112 Jul 05 10:21:02.282753 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 315/630] 10.222.0.16 () {60 vars in 1258 bytes} [Tue Jul 5 10:21:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481047421 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 05 10:21:04.052593 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:04.053180 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:04.060421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:04.060996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:04.061856 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:04.062555 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:04.076750 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 HTTP/1.1 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:04.078578 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.080266 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '550efb9a-0897-4e58-ab8d-19c267ac7787'} Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:04.081110 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.082556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.084004 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:04.084004 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-681b3f12-c2f3-41b9-a95b-19d9846c113b tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 404 len: 111 microversion: 2.20 time: 0.031687 Jul 05 10:21:04.084004 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 316/631] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 5 10:21:04 2022] DELETE /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:04.089984 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:04.091284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 550efb9a-0897-4e58-ab8d-19c267ac7787] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:04.099892 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:04.100465 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:04.101228 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:04.101833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:04.115630 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 HTTP/1.1 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:04.117256 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.118955 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '550efb9a-0897-4e58-ab8d-19c267ac7787'} Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:04.120631 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. Jul 05 10:21:04.122063 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:04.123382 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 550efb9a-0897-4e58-ab8d-19c267ac7787 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:04.123382 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b51c9499-e9cc-49bf-979f-3a9384c6fd97 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787" status: 404 len: 111 microversion: 2.20 time: 0.033608 Jul 05 10:21:04.123382 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 316/632] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:21:04 2022] GET /compute/v2.1/servers/550efb9a-0897-4e58-ab8d-19c267ac7787 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:05.267058 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:05.267599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:05.274690 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:05.275151 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:05.275923 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:05.276360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:05.290322 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded HTTP/1.1 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:05.291872 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.293445 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '791f0134-8c12-4dfd-a93f-254bdfe7fded'} Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:05.294344 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.295820 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.297351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:05.297351 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4747cf26-b793-4cec-804e-69dca924538e tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 404 len: 111 microversion: 2.20 time: 0.030188 Jul 05 10:21:05.297351 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 317/633] 10.222.0.16 () {60 vars in 1279 bytes} [Tue Jul 5 10:21:05 2022] DELETE /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:05.301832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:05.302504 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] [instance: 791f0134-8c12-4dfd-a93f-254bdfe7fded] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:05.309505 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:05.309955 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:05.310822 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:05.311257 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:05.325244 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] HTTP exception thrown: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Request method failure captured: Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded HTTP/1.1 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA6WJeeuIxTo79wrAuPJwVBvWJuj5pwTRxZpUKJH5LmpotdKckeuS6koAtvN8FsumB-Mf1KNwdvBw43LjEWuIpE4yNlhESHMNMNanQnwv_Y3LYSF4-oIq90zpZSoWCjUrnA-Mlg7HlfrKK5ObX4Jaeq__GMHPjNFJtbDLkQvckZaZ0s Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Openstack-Nova-Api-Version: 2.20 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:05.326855 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d343798527cf445295916cc8e8134bf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d343798527cf445295916cc8e8134bf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d343798527cf445295916cc8e8134bf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: d343798527cf445295916cc8e8134bf3 Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2097095589 Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 51e20b9a489342d2b8f0f85542ab370c Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2097095589-project Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.328489 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '791f0134-8c12-4dfd-a93f-254bdfe7fded'} Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:05.329325 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. Jul 05 10:21:05.330674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:05.331787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] Returning 404 to user: Instance 791f0134-8c12-4dfd-a93f-254bdfe7fded could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:05.331787 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fe938a2c-424a-42d4-8500-676ae6f09d00 tempest-AttachVolumeShelveTestJSON-2097095589 tempest-AttachVolumeShelveTestJSON-2097095589-project] 10.222.0.16 "GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded" status: 404 len: 111 microversion: 2.20 time: 0.030324 Jul 05 10:21:05.331787 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 317/634] 10.222.0.16 () {60 vars in 1276 bytes} [Tue Jul 5 10:21:05 2022] GET /compute/v2.1/servers/791f0134-8c12-4dfd-a93f-254bdfe7fded => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:14.303479 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e48720bb-1be2-4017-b287-bcf921565999 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: .version_select at 0x7ffbf01104c0>, body: {"keypair": {"name": "tempest-keypair-1590068828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRf1Yfk8dHVOsbX2APUsagZB3d+s5SSmvAjFwus4K257EIS17iR3aK8yp0Lf5Iae4iz+KGyTU62wWOvD+HTUCb4KdU0TwOcRJiM7AZKneNIJOry+lNKjlddQoK8uSkeDA=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:14.318730 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-e48720bb-1be2-4017-b287-bcf921565999 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for project 46ff9242d2b147f690786e1284d1cfef. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:21:14.322980 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-e48720bb-1be2-4017-b287-bcf921565999 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for user a895ab25adee48a3851ad15657c07a96 and project 46ff9242d2b147f690786e1284d1cfef. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:21:14.347378 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e48720bb-1be2-4017-b287-bcf921565999 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163037 Jul 05 10:21:14.347987 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 318/635] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:21:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:15.626806 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-569245449", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af643123-9a8b-4a2b-993b-8643f71b1cf1"}], "security_groups": [{"name": "tempest-securitygroup--299044797"}], "key_name": "tempest-keypair-1590068828", "user_data": "}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:15.634117 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:15.634805 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:15.745400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] validate_networks() for [('af643123-9a8b-4a2b-993b-8643f71b1cf1', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:21:16.163432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:21:16.163913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:21:16.164446 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:21:16.164905 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:21:16.165368 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:21:16.174985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:16.175504 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:16.176466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:16.176952 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:16.193913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for project 46ff9242d2b147f690786e1284d1cfef. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:21:16.197988 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for user a895ab25adee48a3851ad15657c07a96 and project 46ff9242d2b147f690786e1284d1cfef. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:21:16.209324 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:21:16.212704 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:21:16.266911 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0eee15bd-fb4d-4577-ab6e-f7a24ae77464 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644490 Jul 05 10:21:16.272587 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 318/636] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:21:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:21:16.277928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5f1773cb-4341-4cb7-94c3-152b895b37ea tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:16.278554 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5f1773cb-4341-4cb7-94c3-152b895b37ea tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:16.281022 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=24 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:16.344133 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5f1773cb-4341-4cb7-94c3-152b895b37ea tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:16.351658 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5f1773cb-4341-4cb7-94c3-152b895b37ea tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1237 microversion: 2.1 time: 0.077682 Jul 05 10:21:16.352232 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:16 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:17.370189 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:17.370853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:17.378561 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:17.379365 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:17.380354 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:17.380938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:17.444700 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:17.453316 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7f792d54-4746-45bc-846d-3a534dc38204 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1297 microversion: 2.1 time: 0.088001 Jul 05 10:21:17.453899 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 319/638] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:17 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:18.470934 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:18.471581 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:18.478506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:18.478959 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:18.479759 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:18.480188 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:18.620623 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:18.628312 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-55e2142f-8114-4130-9924-5f29008eb8f6 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.161290 Jul 05 10:21:18.628875 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 320/639] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:18 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:18.876535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-25be1593-43b5-4b9c-84b4-55fb5912b340 req-264a5ecf-a003-481d-a9b1-594fac4d19f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0bd5da-4d04-4474-93dd-ade40cad8f81", "tag": "ebacc285-3d87-49cb-9bf1-0db714210c6d"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:18.886405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-25be1593-43b5-4b9c-84b4-55fb5912b340 req-264a5ecf-a003-481d-a9b1-594fac4d19f5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:18.887079 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-25be1593-43b5-4b9c-84b4-55fb5912b340 req-264a5ecf-a003-481d-a9b1-594fac4d19f5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:18.904029 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-25be1593-43b5-4b9c-84b4-55fb5912b340 req-264a5ecf-a003-481d-a9b1-594fac4d19f5 service nova] Creating event network-changed:ebacc285-3d87-49cb-9bf1-0db714210c6d for instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 on hv-cinder-maste Jul 05 10:21:18.909826 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-25be1593-43b5-4b9c-84b4-55fb5912b340 req-264a5ecf-a003-481d-a9b1-594fac4d19f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037210 Jul 05 10:21:18.910621 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 320/640] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:19.648694 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:19.649547 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:19.658439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:19.658991 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:19.660112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:19.660818 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:19.799219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:19.807102 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-87cd2b6f-6dd6-46bf-8c7c-c4793b97e182 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.164534 Jul 05 10:21:19.807736 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 321/641] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:19 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:20.830201 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:20.831397 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:20.842720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:20.843473 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:20.844752 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:20.845477 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:20.987631 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:20.998871 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-be3f2b63-08b0-489c-9173-f001feb79f72 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.176403 Jul 05 10:21:20.999684 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 321/642] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:20 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:22.018255 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:22.018886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:22.025755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:22.026175 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:22.026946 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:22.027371 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:22.165618 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:22.173242 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ee3aeaa9-4edc-477f-9aa9-4462782d0892 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.158904 Jul 05 10:21:22.173806 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 322/643] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:22 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:23.194711 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:23.195408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:23.202594 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:23.203058 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:23.203855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:23.204300 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:23.332773 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:23.340837 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-44df0398-92bd-4f9c-b098-9e23650b9c12 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.151919 Jul 05 10:21:23.341413 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:23 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:24.358887 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:24.359503 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:24.366401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:24.366881 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:24.367660 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:24.368090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:24.510267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:24.518525 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-63909139-9b2e-4e1a-ba2f-2de0aef37ec8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.163523 Jul 05 10:21:24.519107 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:24 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:21:25.540001 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:25.540936 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:25.552169 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:25.552641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:25.553396 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:25.553849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:25.693467 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:25.704781 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a8a5a713-3bec-4a4f-a484-c7bc18cb3fda tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.171156 Jul 05 10:21:25.705522 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 323/646] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:25 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:25.893746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-019fc991-cbb0-4b48-95fa-e9b6097940d5 req-b41301ed-c5cb-45fa-ac85-6e83d67817b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0bd5da-4d04-4474-93dd-ade40cad8f81", "name": "network-vif-plugged", "status": "completed", "tag": "ebacc285-3d87-49cb-9bf1-0db714210c6d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:25.902903 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-019fc991-cbb0-4b48-95fa-e9b6097940d5 req-b41301ed-c5cb-45fa-ac85-6e83d67817b5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:25.903285 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-019fc991-cbb0-4b48-95fa-e9b6097940d5 req-b41301ed-c5cb-45fa-ac85-6e83d67817b5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:25.914786 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-019fc991-cbb0-4b48-95fa-e9b6097940d5 req-b41301ed-c5cb-45fa-ac85-6e83d67817b5 service nova] Creating event network-vif-plugged:ebacc285-3d87-49cb-9bf1-0db714210c6d for instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 on hv-cinder-maste Jul 05 10:21:25.919990 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-019fc991-cbb0-4b48-95fa-e9b6097940d5 req-b41301ed-c5cb-45fa-ac85-6e83d67817b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jul 05 10:21:25.920642 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 324/647] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:26.723708 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:26.724438 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:26.726515 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:26.727195 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:26.734053 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:26.734542 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:26.735314 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:26.735766 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:26.875482 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:26.883239 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ac1b2658-73a3-4b63-a531-e3561b326a17 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1362 microversion: 2.1 time: 0.163615 Jul 05 10:21:26.883799 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 324/648] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:26 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:27.900382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:27.907950 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:27.909103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:27.917397 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:27.917850 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:27.918661 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:27.919102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:28.055663 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:28.063792 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-501806ce-fb88-4736-a111-e49ec361eb96 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1549 microversion: 2.1 time: 0.165414 Jul 05 10:21:28.064361 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 325/649] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:27 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:28.080569 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:28.081099 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:28.088333 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:28.088827 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:28.089592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:28.090025 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:28.167536 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-898c8179-e373-4aa5-accb-17e912354cc1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091008 Jul 05 10:21:28.168142 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 325/650] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:21:28 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:29.127496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-f91ac349-8182-4948-9201-61a9a552fe9a req-04730296-4fa3-4430-9574-5754b7759e74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0bd5da-4d04-4474-93dd-ade40cad8f81", "tag": "ebacc285-3d87-49cb-9bf1-0db714210c6d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:29.132671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:29.136727 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f91ac349-8182-4948-9201-61a9a552fe9a req-04730296-4fa3-4430-9574-5754b7759e74 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:29.137172 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-f91ac349-8182-4948-9201-61a9a552fe9a req-04730296-4fa3-4430-9574-5754b7759e74 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:29.149913 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-f91ac349-8182-4948-9201-61a9a552fe9a req-04730296-4fa3-4430-9574-5754b7759e74 service nova] Creating event network-changed:ebacc285-3d87-49cb-9bf1-0db714210c6d for instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 on hv-cinder-maste Jul 05 10:21:29.155068 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-f91ac349-8182-4948-9201-61a9a552fe9a req-04730296-4fa3-4430-9574-5754b7759e74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 Jul 05 10:21:29.155822 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 326/651] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:36.478581 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:36.479266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:36.486769 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:36.487292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:36.488175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:36.488679 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:36.514777 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b17a0b7b-90e4-4cd6-a5dc-c1175feddd96 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/ips" status: 200 len: 151 microversion: 2.1 time: 0.043156 Jul 05 10:21:36.515324 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 326/652] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:21:36 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:37.842571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b815eef-653a-49ac-8201-1897b86ea2cb"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:37.843717 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:37.851034 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:37.851486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:37.852246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:37.852671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:38.122552 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bbddffa2-8583-4a9a-b91a-036b0cb8b29c tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "POST /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284301 Jul 05 10:21:38.123168 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 327/653] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:21:37 2022] POST /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:40.470682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:40.471207 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:40.477798 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:40.478252 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:40.479133 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:40.479556 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:40.561682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lazy-loading 'services' on Instance uuid 133a6605-7651-497a-b49a-b87fe8789a4a {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:21:40.634049 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-64500c4a-866c-40b6-a610-45793d367e89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments/9b815eef-653a-49ac-8201-1897b86ea2cb" status: 202 len: 0 microversion: 2.1 time: 0.167382 Jul 05 10:21:40.634879 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 327/654] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:21:40 2022] DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments/9b815eef-653a-49ac-8201-1897b86ea2cb => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:21:40.644516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:40.645638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:40.652609 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:40.653134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:40.653905 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:40.654401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:40.686554 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-cdda2a89-c605-4316-a4d5-10388d524e52 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Jul 05 10:21:40.687122 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 328/655] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:21:40 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:41.699959 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:41.700988 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:41.708008 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.708442 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:41.709191 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.709613 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:41.737813 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-32257b23-7315-46bc-898f-40b9d101fb42 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043214 Jul 05 10:21:41.738393 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 328/656] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:21:41 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:21:41.799232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:41.799744 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:41.806600 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.806988 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:41.807749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.808181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:41.833318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:21:41.914704 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bb117fe1-c9ce-424e-a5f3-9cba56fe8717 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 204 len: 0 microversion: 2.1 time: 0.118956 Jul 05 10:21:41.915472 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 329/657] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:21:41 2022] DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:21:41.924215 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:41.924816 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:41.931088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.931535 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:41.932386 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:41.932817 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:42.080445 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:42.091680 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-452b560b-4eb6-4005-945c-bfac9877a5b0 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1683 microversion: 2.1 time: 0.171365 Jul 05 10:21:42.092253 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 329/658] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:41 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:43.114757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:43.115752 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:43.126648 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:43.127370 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:43.128664 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:43.129382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:43.285084 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:43.293097 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bb5bf269-b34e-43d4-a28a-80734b6456c6 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1683 microversion: 2.1 time: 0.185721 Jul 05 10:21:43.293693 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 330/659] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:43 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:44.311315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:44.311938 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:44.318747 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:44.319184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:44.319925 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:44.320346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:44.459241 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:44.468007 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-695cff1e-77f7-48e9-ab4c-4eb291f90c7a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1683 microversion: 2.1 time: 0.160702 Jul 05 10:21:44.468580 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 330/660] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:44 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:21:45.139300 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-7e60f57a-7d29-4240-af78-fe90e75bdda1 req-bc3fe40f-ad7b-4bb6-8a0e-59a9432c6ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133a6605-7651-497a-b49a-b87fe8789a4a", "name": "network-vif-deleted", "tag": "74c6a5ec-7e14-46cd-bebf-6587eeafc55b"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:45.148540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7e60f57a-7d29-4240-af78-fe90e75bdda1 req-bc3fe40f-ad7b-4bb6-8a0e-59a9432c6ceb service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:45.148982 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-7e60f57a-7d29-4240-af78-fe90e75bdda1 req-bc3fe40f-ad7b-4bb6-8a0e-59a9432c6ceb service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:45.160412 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-7e60f57a-7d29-4240-af78-fe90e75bdda1 req-bc3fe40f-ad7b-4bb6-8a0e-59a9432c6ceb service nova] Creating event network-vif-deleted:74c6a5ec-7e14-46cd-bebf-6587eeafc55b for instance 133a6605-7651-497a-b49a-b87fe8789a4a on hv-cinder-maste Jul 05 10:21:45.165106 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-7e60f57a-7d29-4240-af78-fe90e75bdda1 req-bc3fe40f-ad7b-4bb6-8a0e-59a9432c6ceb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 Jul 05 10:21:45.166070 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 331/661] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:45.485336 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:45.485893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:45.492780 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:45.493223 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:45.493974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:45.494615 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:45.525590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:45.526083 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:45.527382 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lazy-loading 'fault' on Instance uuid 133a6605-7651-497a-b49a-b87fe8789a4a {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:21:45.571800 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae9cd6d6d5824aa1932d3353578285af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96cc7b005126403f94110029f4242a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:21:45.579418 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b29e464b-a2a7-405e-915e-2aa8d4871df8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 200 len: 1331 microversion: 2.1 time: 0.098051 Jul 05 10:21:45.580019 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 331/662] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:45 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:21:46.598577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:46.599278 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:46.605855 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:46.606339 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:46.607103 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:46.607686 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:46.610343 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:46.622692 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a HTTP/1.1 Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:46.624377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:46.626045 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '133a6605-7651-497a-b49a-b87fe8789a4a'} Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:46.626999 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:46.628646 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:46.630115 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:46.630115 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2b4965bd-1d01-4ecd-923e-60dfc87c0473 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 404 len: 111 microversion: 2.1 time: 0.031958 Jul 05 10:21:46.630115 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 332/663] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:46 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:46.634732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-78edf2bc-888e-4eda-a40b-03c11d41e209 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '.version_select at 0x7ffbf01bc790>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:46.640812 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:46.655346 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-78edf2bc-888e-4eda-a40b-03c11d41e209 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805733162" status: 202 len: 0 microversion: 2.1 time: 0.024388 Jul 05 10:21:46.655944 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 332/664] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 5 10:21:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805733162 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:21:48.426720 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:48.427246 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:48.434618 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:48.435061 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:48.435835 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:48.436265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:48.450631 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a HTTP/1.1 Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:48.452166 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.453649 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '133a6605-7651-497a-b49a-b87fe8789a4a'} Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:48.457493 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.458698 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.459875 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:48.459875 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a5b28409-8ba2-400a-86bd-5d12dea00b92 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 404 len: 111 microversion: 2.1 time: 0.031365 Jul 05 10:21:48.459875 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:21:48 2022] DELETE /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:48.462783 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:48.463390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 133a6605-7651-497a-b49a-b87fe8789a4a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:48.469908 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:48.470380 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:48.471145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:48.471568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:48.474146 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:21:48.486572 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a HTTP/1.1 Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:48.488259 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.489707 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '133a6605-7651-497a-b49a-b87fe8789a4a'} Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:48.490507 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. Jul 05 10:21:48.491660 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:48.492694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 133a6605-7651-497a-b49a-b87fe8789a4a could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:48.492694 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a9568941-488f-4099-b720-e99980ade3cb tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jul 05 10:21:48.492694 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 333/666] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:48 2022] GET /compute/v2.1/servers/133a6605-7651-497a-b49a-b87fe8789a4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:49.650287 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:49.650943 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:49.658080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.658656 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.659416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.659843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.673814 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 HTTP/1.1 Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:49.675374 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.676903 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '7601d2a5-817c-4e1c-b38c-6fae04f45c03'} Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:49.677701 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.678944 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.680118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:49.680118 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-14a6b184-ac95-4996-b31c-76ffca18f9a8 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jul 05 10:21:49.680118 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 334/667] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:21:49 2022] DELETE /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:49.685706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:49.686370 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 7601d2a5-817c-4e1c-b38c-6fae04f45c03] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:49.693584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.694035 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.694829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.695260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.708722 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 HTTP/1.1 Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:49.710239 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.711998 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '7601d2a5-817c-4e1c-b38c-6fae04f45c03'} Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:49.712973 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. Jul 05 10:21:49.714653 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.716020 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 7601d2a5-817c-4e1c-b38c-6fae04f45c03 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:49.716020 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b400fc27-5005-4e8c-a25c-5032ce971d89 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03" status: 404 len: 111 microversion: 2.1 time: 0.030018 Jul 05 10:21:49.716020 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 334/668] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:49 2022] GET /compute/v2.1/servers/7601d2a5-817c-4e1c-b38c-6fae04f45c03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:49.720495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:49.720993 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:49.727059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.727534 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.728288 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.728707 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.741940 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 HTTP/1.1 Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:49.743508 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.745097 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '056f41b2-532d-4fd1-8892-10ef1c06cfb4'} Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:49.746357 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.747782 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.749240 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:49.749240 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b33c9a6e-ab2f-4743-9edc-61c153bba453 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 404 len: 111 microversion: 2.1 time: 0.028209 Jul 05 10:21:49.749240 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 335/669] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:21:49 2022] DELETE /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:49.753280 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:49.753888 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: 056f41b2-532d-4fd1-8892-10ef1c06cfb4] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:49.760393 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.760846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.761614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:49.762070 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:49.776014 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 HTTP/1.1 Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:49.777675 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.779281 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '056f41b2-532d-4fd1-8892-10ef1c06cfb4'} Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:49.780243 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. Jul 05 10:21:49.781799 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:49.783322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance 056f41b2-532d-4fd1-8892-10ef1c06cfb4 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:49.783322 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d63f168-bb1a-49aa-ab15-a81c0189a781 tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4" status: 404 len: 111 microversion: 2.1 time: 0.029860 Jul 05 10:21:49.783322 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 335/670] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:49 2022] GET /compute/v2.1/servers/056f41b2-532d-4fd1-8892-10ef1c06cfb4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 10:21:50.930922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:50.931535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:50.939239 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:50.939615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:50.940386 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:50.940820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:50.954816 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 HTTP/1.1 Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:50.956377 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.957915 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'b30ebea8-e028-471f-8d15-0513972e2331'} Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:50.958854 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.960410 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.962594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:50.962594 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-12dd1eca-420a-486d-a916-bd4703bc6e3d tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 404 len: 111 microversion: 2.1 time: 0.031434 Jul 05 10:21:50.962594 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 336/671] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:21:50 2022] DELETE /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:50.966790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:50.967403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] [instance: b30ebea8-e028-471f-8d15-0513972e2331] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:21:50.974193 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:50.974678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:50.975469 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:21:50.975904 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:21:50.989576 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] HTTP exception thrown: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Request method failure captured: Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 HTTP/1.1 Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixA7duDkbRxlh65xcVT4GkAEHT4rmB7p-NDyl3YvxoYQfad_JynwghdzI9SDkJ1_5EbgDzNb2YJ4UBVn6oqOCJ_Zbx5ksSOx2MWMgVXE2M9lAF-jbo0544ee5s1znR0RiHDcIxMGr2TR9Ti32UdK64PT8ECS6Psx1uV4zHqfSs_fjtXY Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:50.991182 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_96cc7b005126403f94110029f4242a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/96cc7b005126403f94110029f4242a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/96cc7b005126403f94110029f4242a9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 96cc7b005126403f94110029f4242a9f Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1699938277 Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: ae9cd6d6d5824aa1932d3353578285af Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeNegativeTest-1699938277-project Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.992747 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': 'b30ebea8-e028-471f-8d15-0513972e2331'} Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:50.993694 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. Jul 05 10:21:50.995352 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:50.996823 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] Returning 404 to user: Instance b30ebea8-e028-471f-8d15-0513972e2331 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:50.996823 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d4364e31-6a2e-40ce-ae29-bf3b3efe534a tempest-AttachVolumeNegativeTest-1699938277 tempest-AttachVolumeNegativeTest-1699938277-project] 10.222.0.16 "GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331" status: 404 len: 111 microversion: 2.1 time: 0.029817 Jul 05 10:21:50.996823 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 336/672] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:21:50 2022] GET /compute/v2.1/servers/b30ebea8-e028-471f-8d15-0513972e2331 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:55.386820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f0bf7353-ec72-4d40-8038-0e11b5d49f72 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Action: 'create', calling method: .version_select at 0x7ffbf00871f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1125582921", "metadata": {"Type": "work"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:55.675466 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f0bf7353-ec72-4d40-8038-0e11b5d49f72 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.418519 Jul 05 10:21:55.676127 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 337/673] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 5 10:21:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 05 10:21:55.687007 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b252c6f7-663b-44d1-b6b8-2ad92177d7fb tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf01bcc10>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:55.735867 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b252c6f7-663b-44d1-b6b8-2ad92177d7fb tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 200 len: 353 microversion: 2.1 time: 0.052602 Jul 05 10:21:55.736438 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 337/674] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:55 2022] GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:56.753411 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9e3beb1c-822e-45b8-84fb-727a9f001148 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf00ab940>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:56.808581 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9e3beb1c-822e-45b8-84fb-727a9f001148 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 200 len: 354 microversion: 2.1 time: 0.062370 Jul 05 10:21:56.809171 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 338/675] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:56 2022] GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:56.820630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-18253673-480a-4f8a-9387-42a2293dd512 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf0183280>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:56.871188 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-18253673-480a-4f8a-9387-42a2293dd512 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 200 len: 354 microversion: 2.1 time: 0.054756 Jul 05 10:21:56.871778 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 338/676] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:56 2022] GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:56.883503 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-62adf80d-516b-422d-8486-c268ee20c19a tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf0514160>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:56.947007 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-62adf80d-516b-422d-8486-c268ee20c19a tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 202 len: 0 microversion: 2.1 time: 0.067478 Jul 05 10:21:56.947579 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 339/677] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:21:56 2022] DELETE /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:21:56.955787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-631cf6c4-685b-4216-ba8f-983d816fa010 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf01188b0>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:57.004261 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-631cf6c4-685b-4216-ba8f-983d816fa010 tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 200 len: 353 microversion: 2.1 time: 0.052395 Jul 05 10:21:57.004831 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 339/678] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:56 2022] GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:21:58.021686 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fdffe8be-7e43-481d-9fe2-286b6c42b07b tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Calling method '.version_select at 0x7ffbf012d700>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:58.058443 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-fdffe8be-7e43-481d-9fe2-286b6c42b07b tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] HTTP exception thrown: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fdffe8be-7e43-481d-9fe2-286b6c42b07b tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Request method failure captured: Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d HTTP/1.1 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDDMj6oVaSGAf4NA7jJBWiJsyZMH1Ucoi5Io7Mw1Mv2GImCqVDiwcOfPuh903RWEJRbDGfiDD_a3--sIXrj4s34G450bqE4MmpOAA5y0nUFBVW4iiSWa8TKX4O1bWV3KjYWXzC2mvaz5QPH1aP2NRw-LvU0qbxeSA90lt2aRN6zss4 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: f2a1304ab7a544d8b5d82bd39711eb3c Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesGetTestJSON-349589631 Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:58.060379 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f2a1304ab7a544d8b5d82bd39711eb3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f2a1304ab7a544d8b5d82bd39711eb3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f2a1304ab7a544d8b5d82bd39711eb3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f2a1304ab7a544d8b5d82bd39711eb3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesGetTestJSON-349589631 Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: f2a1304ab7a544d8b5d82bd39711eb3c Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesGetTestJSON-349589631 Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesGetTestJSON-349589631-project Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: a09853f4dbc34f3781afbf61096531a3 Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesGetTestJSON-349589631-project Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '0814b9ae-83be-4cfd-88cc-4cb3c3491b5d'} Jul 05 10:21:58.061869 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. (HTTP 404) (Request-ID: req-b374b729-794f-42d5-b82a-0a7c860b2c30) Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:58.062930 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:21:58.064332 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 10:21:58.065705 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fdffe8be-7e43-481d-9fe2-286b6c42b07b tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] Returning 404 to user: Volume 0814b9ae-83be-4cfd-88cc-4cb3c3491b5d could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fdffe8be-7e43-481d-9fe2-286b6c42b07b tempest-VolumesGetTestJSON-349589631 tempest-VolumesGetTestJSON-349589631-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d" status: 404 len: 109 microversion: 2.1 time: 0.047396 Jul 05 10:21:58.067079 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 340/679] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:58 2022] GET /compute/v2.1/os-volumes/0814b9ae-83be-4cfd-88cc-4cb3c3491b5d => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:59.539387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c731dcda-3657-4379-b72b-72c5ba0a446b tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Action: 'create', calling method: .version_select at 0x7ffbf0147700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1266380732", "metadata": {"Type": "work"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c731dcda-3657-4379-b72b-72c5ba0a446b tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 122 Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:59.562988 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1266380732", "metadata": {"Type": "work"}}} Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: Jul 05 10:21:59.564637 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1266380732', 'metadata': {'Type': 'work'}}}} Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise error Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi '#$%' Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.565569 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 10:21:59.566978 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 10:21:59.568129 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 05 10:21:59.568129 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.568129 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c731dcda-3657-4379-b72b-72c5ba0a446b tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.568129 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c731dcda-3657-4379-b72b-72c5ba0a446b tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146372 Jul 05 10:21:59.568129 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 340/680] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 5 10:21:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:59.575466 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2852ad26-1538-40ef-9aba-6a3bbe148382 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Action: 'create', calling method: .version_select at 0x7ffbf00f2430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013473777", "metadata": {"Type": "work"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2852ad26-1538-40ef-9aba-6a3bbe148382 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 120 Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:59.578886 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013473777", "metadata": {"Type": "work"}}} Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:21:59.580373 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2013473777', 'metadata': {'Type': 'work'}}}} Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise error Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi '0' Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.581253 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 10:21:59.582571 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 10:21:59.583678 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 05 10:21:59.583678 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.583678 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2852ad26-1538-40ef-9aba-6a3bbe148382 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.583678 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2852ad26-1538-40ef-9aba-6a3bbe148382 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009843 Jul 05 10:21:59.583678 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 341/681] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 5 10:21:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:59.589627 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d2f66ab4-c806-4a8a-a597-66c79b6ec027 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Action: 'create', calling method: .version_select at 0x7ffbf018f9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1628245344", "metadata": {"Type": "work"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d2f66ab4-c806-4a8a-a597-66c79b6ec027 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 119 Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:59.591969 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1628245344", "metadata": {"Type": "work"}}} Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: Jul 05 10:21:59.593571 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1628245344', 'metadata': {'Type': 'work'}}}} Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise error Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi '' Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.594611 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 05 10:21:59.596184 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 05 10:21:59.597749 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 05 10:21:59.597749 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.597749 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d2f66ab4-c806-4a8a-a597-66c79b6ec027 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.597749 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d2f66ab4-c806-4a8a-a597-66c79b6ec027 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007783 Jul 05 10:21:59.597749 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 341/682] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Jul 5 10:21:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 05 10:21:59.602134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-635cef0a-fcdf-4d1b-867a-e51f206e40df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Calling method '.version_select at 0x7ffbf013c5e0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:59.629715 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-635cef0a-fcdf-4d1b-867a-e51f206e40df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] HTTP exception thrown: Volume tempest-invalid-2047428992 could not be found. Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-635cef0a-fcdf-4d1b-867a-e51f206e40df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2047428992 HTTP/1.1 Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:59.631666 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume tempest-invalid-2047428992 could not be found. Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'tempest-invalid-2047428992'} Jul 05 10:21:59.633202 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2047428992 could not be found. (HTTP 404) (Request-ID: req-eb508948-2283-4706-b2af-06eb2a51199a) Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.634136 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:21:59.635543 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2047428992 could not be found. Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:59.636686 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2047428992 could not be found. Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2047428992 could not be found. Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-635cef0a-fcdf-4d1b-867a-e51f206e40df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 404 to user: Volume tempest-invalid-2047428992 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-635cef0a-fcdf-4d1b-867a-e51f206e40df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2047428992" status: 404 len: 99 microversion: 2.1 time: 0.034446 Jul 05 10:21:59.637924 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 342/683] 10.222.0.16 () {58 vars in 1217 bytes} [Tue Jul 5 10:21:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2047428992 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 05 10:21:59.644892 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0f43b29b-e039-40bc-9ed7-4241ac3d8caa tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003922 Jul 05 10:21:59.645396 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 342/684] 10.222.0.16 () {58 vars in 1139 bytes} [Tue Jul 5 10:21:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 10:21:59.654537 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8d66de7b-77ee-4c76-9b7a-8b3cda979f39 tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004404 Jul 05 10:21:59.655026 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 343/685] 10.222.0.16 () {58 vars in 1136 bytes} [Tue Jul 5 10:21:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 05 10:21:59.662978 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-84501b75-0dfa-4975-818e-80b5e2b148df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Calling method '.version_select at 0x7ffbf0183550>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:59.691562 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-84501b75-0dfa-4975-818e-80b5e2b148df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] HTTP exception thrown: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-84501b75-0dfa-4975-818e-80b5e2b148df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: DELETE /compute/v2.1/os-volumes/41307fd7-5464-455a-b92c-c6869d61a1f1 HTTP/1.1 Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:21:59.694879 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '41307fd7-5464-455a-b92c-c6869d61a1f1'} Jul 05 10:21:59.696359 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. (HTTP 404) (Request-ID: req-a5bca86f-a9a6-4fc7-9418-c20c5198bfef) Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.697310 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 05 10:21:59.698664 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 05 10:21:59.699902 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-84501b75-0dfa-4975-818e-80b5e2b148df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 404 to user: Volume 41307fd7-5464-455a-b92c-c6869d61a1f1 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-84501b75-0dfa-4975-818e-80b5e2b148df tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/41307fd7-5464-455a-b92c-c6869d61a1f1" status: 404 len: 109 microversion: 2.1 time: 0.036808 Jul 05 10:21:59.701281 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 343/686] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:21:59 2022] DELETE /compute/v2.1/os-volumes/41307fd7-5464-455a-b92c-c6869d61a1f1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:21:59.706070 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8b29f145-9b6c-4a2f-b30f-103293c0082d tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Calling method '.version_select at 0x7ffbf013c430>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:21:59.733901 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-8b29f145-9b6c-4a2f-b30f-103293c0082d tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] HTTP exception thrown: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8b29f145-9b6c-4a2f-b30f-103293c0082d tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Request method failure captured: Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/os-volumes/360b33af-8625-4adf-a5d2-309fa18efb7b HTTP/1.1 Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDH_32qnL8H-IxxiAqDsZ8cv8hTozsdsJdvRBLBzkLXabfy2NYNd1vFfbgUp1pfEagk_52SrTgwjbvuqIgiujlEhz7f8PIH2ezIuduV-I5PiPvPMluI3Olazvxa_whtn4zjaOGgmgflUePsGptjzqttE7px5FE900QixzxtvJM4CYQ Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:21:59.735965 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/863290e696b6400cb8d47ecd79ef32ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 863290e696b6400cb8d47ecd79ef32ad Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesNegativeTest-413219459 Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: d1495f4766bf43ba847b55507e1010c7 Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesNegativeTest-413219459-project Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '360b33af-8625-4adf-a5d2-309fa18efb7b'} Jul 05 10:21:59.737386 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. (HTTP 404) (Request-ID: req-72410ba4-5a40-4896-8bcd-15d3af5d34e3) Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.738276 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 05 10:21:59.739537 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 05 10:21:59.741161 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8b29f145-9b6c-4a2f-b30f-103293c0082d tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] Returning 404 to user: Volume 360b33af-8625-4adf-a5d2-309fa18efb7b could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8b29f145-9b6c-4a2f-b30f-103293c0082d tempest-VolumesNegativeTest-413219459 tempest-VolumesNegativeTest-413219459-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/360b33af-8625-4adf-a5d2-309fa18efb7b" status: 404 len: 109 microversion: 2.1 time: 0.035336 Jul 05 10:21:59.742692 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 344/687] 10.222.0.16 () {58 vars in 1244 bytes} [Tue Jul 5 10:21:59 2022] GET /compute/v2.1/os-volumes/360b33af-8625-4adf-a5d2-309fa18efb7b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:22:23.539767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:23.540548 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=7 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:23.546142 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2042447925", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "b5be5a54-84fc-4271-ae8a-c420d5c3b339"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:23.600175 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] validate_networks() for [('b5be5a54-84fc-4271-ae8a-c420d5c3b339', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:22:23.952583 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:22:23.953068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:22:23.953602 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:22:23.954067 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:22:23.954596 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:22:23.965160 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:23.965538 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:23.966425 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:23.966859 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:23.984561 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Getting quotas for project 5ab94d9d4e204ffe9904139a9cf7c9ed. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:22:23.988972 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Getting quotas for user c2e5b1e9bab54b63af28a0c9eb295610 and project 5ab94d9d4e204ffe9904139a9cf7c9ed. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:22:24.001177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:22:24.003485 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:22:24.051915 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ed496f81-93ae-428b-b85d-5ae6b1080fa6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514304 Jul 05 10:22:24.052563 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 344/688] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:22:24.060006 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:24.061392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=9 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:24.066038 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-81c25368-d80d-45a5-921d-dc8c35806c9e tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:24.066687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-81c25368-d80d-45a5-921d-dc8c35806c9e tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:24.122742 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-81c25368-d80d-45a5-921d-dc8c35806c9e tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:24.129507 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-81c25368-d80d-45a5-921d-dc8c35806c9e tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1214 microversion: 2.1 time: 0.070716 Jul 05 10:22:24.130511 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 345/689] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:24 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:25.147602 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:25.148319 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:25.156067 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:25.156543 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:25.157388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:25.157756 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:25.357883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:25.366590 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6056d410-4ece-4f12-99f0-271ee6e68963 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1284 microversion: 2.1 time: 0.223492 Jul 05 10:22:25.367171 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 345/690] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:25 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:26.383980 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:26.384629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:26.391459 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:26.391907 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:26.392644 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:26.393070 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:26.540818 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-97d6be31-256c-4443-9574-ba8bc3296792 req-6c405a41-9648-40b2-9185-5429c65713c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b84939-57f9-4b26-9014-dcf622d6aaa5", "tag": "7fcba936-1be2-44d8-a878-5fb770c15fae"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:26.550886 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-97d6be31-256c-4443-9574-ba8bc3296792 req-6c405a41-9648-40b2-9185-5429c65713c4 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:26.551666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-97d6be31-256c-4443-9574-ba8bc3296792 req-6c405a41-9648-40b2-9185-5429c65713c4 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:26.570589 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-97d6be31-256c-4443-9574-ba8bc3296792 req-6c405a41-9648-40b2-9185-5429c65713c4 service nova] Creating event network-changed:7fcba936-1be2-44d8-a878-5fb770c15fae for instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 on hv-cinder-maste Jul 05 10:22:26.575575 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-97d6be31-256c-4443-9574-ba8bc3296792 req-6c405a41-9648-40b2-9185-5429c65713c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038525 Jul 05 10:22:26.576189 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 346/691] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:26.597151 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:26.605026 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6864857c-e3b1-400b-8b2f-090e5f782198 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.225049 Jul 05 10:22:26.605591 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 346/692] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:26 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:27.623282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:27.623990 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:27.630650 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:27.631091 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:27.631864 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:27.632288 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:27.769167 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:27.777428 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-182a8a2f-2a19-46e4-a865-91402fa1b46a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.158917 Jul 05 10:22:27.778006 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 347/693] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:27 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:28.794690 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:28.795298 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:28.802151 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:28.802630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:28.803420 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:28.803878 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:28.941964 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:28.950064 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3f6b6621-69b3-4221-9887-8bfc3a0ae841 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.159399 Jul 05 10:22:28.950709 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 347/694] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:28 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:29.974415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:29.975362 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:29.986592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:29.987343 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:29.988584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:29.989301 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:30.119740 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:30.129751 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-02baa734-8291-4128-9b51-3cf95522b763 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.161635 Jul 05 10:22:30.130562 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 348/695] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:29 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:31.147582 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:31.148206 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:31.155008 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:31.155506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:31.156191 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:31.156615 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:31.298002 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:31.310431 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d22067c5-8d75-4841-ab27-187e1272d177 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.166597 Jul 05 10:22:31.311284 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 348/696] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:31 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:32.310833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-22583144-0449-4ea8-8c64-279527699174 req-5e965928-0e9f-4aa5-a65e-b4016346ed74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b84939-57f9-4b26-9014-dcf622d6aaa5", "name": "network-vif-plugged", "status": "completed", "tag": "7fcba936-1be2-44d8-a878-5fb770c15fae"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:32.320592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-22583144-0449-4ea8-8c64-279527699174 req-5e965928-0e9f-4aa5-a65e-b4016346ed74 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:32.321285 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-22583144-0449-4ea8-8c64-279527699174 req-5e965928-0e9f-4aa5-a65e-b4016346ed74 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:32.326892 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:32.328076 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:32.334423 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:32.334673 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-22583144-0449-4ea8-8c64-279527699174 req-5e965928-0e9f-4aa5-a65e-b4016346ed74 service nova] Creating event network-vif-plugged:7fcba936-1be2-44d8-a878-5fb770c15fae for instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 on hv-cinder-maste Jul 05 10:22:32.335106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:32.336222 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:32.336645 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:32.340442 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-22583144-0449-4ea8-8c64-279527699174 req-5e965928-0e9f-4aa5-a65e-b4016346ed74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 Jul 05 10:22:32.342965 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 349/697] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:32.476992 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:32.484839 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e95f9168-66be-439a-a47a-41aec6550946 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.161959 Jul 05 10:22:32.485414 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 349/698] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:32 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:22:33.502115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:33.502916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:33.510693 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:33.511147 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:33.512001 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:33.512468 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:33.648174 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:33.656259 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-062092aa-c586-421b-b1a2-29b2de8a3ee5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1314 microversion: 2.1 time: 0.158810 Jul 05 10:22:33.656823 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 350/699] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:33 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:34.677421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:34.678453 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:34.682170 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:34.691654 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:34.692388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:34.693688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:34.694447 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:34.836998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:34.844919 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d41157c6-4f71-449c-89d8-6509253f6af0 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1498 microversion: 2.1 time: 0.174034 Jul 05 10:22:34.845498 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 350/700] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:34 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:35.279201 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:35.279854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:35.282083 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:35.282789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:35.289514 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:35.289963 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:35.290776 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:35.291211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:35.318915 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:22:35.401521 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e56e68f4-a645-49bf-b18b-0ddfb3cb903b tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 204 len: 0 microversion: 2.1 time: 0.125942 Jul 05 10:22:35.402101 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 351/701] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:22:35 2022] DELETE /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:22:35.410594 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:35.411227 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:35.417664 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:35.418758 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:35.419575 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:35.420049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:35.555044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:35.562927 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-21b6f97f-be51-4b03-a1e6-3ea61a1d65bb tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1504 microversion: 2.1 time: 0.156284 Jul 05 10:22:35.563496 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 351/702] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:35 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:22:36.581873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:36.582623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:36.589688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:36.590125 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:36.590899 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:36.591322 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:36.736057 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:36.747093 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-82475d9c-db3b-412e-a2c8-6bd8818f9ff9 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1504 microversion: 2.1 time: 0.169518 Jul 05 10:22:36.747641 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 352/703] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:36 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:37.753327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-a32a49fd-f845-46b4-93bc-c98bce6c57dc req-72b31e74-4b68-4856-aec2-0fd1045bfe57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b84939-57f9-4b26-9014-dcf622d6aaa5", "name": "network-vif-deleted", "tag": "7fcba936-1be2-44d8-a878-5fb770c15fae"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:37.762529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a32a49fd-f845-46b4-93bc-c98bce6c57dc req-72b31e74-4b68-4856-aec2-0fd1045bfe57 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:37.762981 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-a32a49fd-f845-46b4-93bc-c98bce6c57dc req-72b31e74-4b68-4856-aec2-0fd1045bfe57 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:37.765102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:37.767431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:37.775091 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-a32a49fd-f845-46b4-93bc-c98bce6c57dc req-72b31e74-4b68-4856-aec2-0fd1045bfe57 service nova] Creating event network-vif-deleted:7fcba936-1be2-44d8-a878-5fb770c15fae for instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 on hv-cinder-maste Jul 05 10:22:37.775293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:37.775717 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:37.776673 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:37.777094 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:37.780189 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-a32a49fd-f845-46b4-93bc-c98bce6c57dc req-72b31e74-4b68-4856-aec2-0fd1045bfe57 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030490 Jul 05 10:22:37.780928 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 352/704] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:37.844452 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:37.852495 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dd7dc3ef-a70a-41f4-872e-c298a5e6cc3d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 200 len: 1462 microversion: 2.1 time: 0.092250 Jul 05 10:22:37.853081 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 353/705] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:37 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:38.876625 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:38.877757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: 87b84939-57f9-4b26-9014-dcf622d6aaa5] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:38.890056 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:38.890964 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:38.892654 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:38.893460 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:38.911873 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] HTTP exception thrown: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Request method failure captured: Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 HTTP/1.1 Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDdoCMV2fbkQclISWHjeuvj1yWEELXj1LusC5g8m1Jo_gQdPyeVvqU7d8HzDjO6Lacb--R2yHtuD9uoOouCnLSuaqBzaxwQDCGGNihfB3VNj5SiuCwWwwIaDz3Ye6saF0E1hvD0ADqoO3_xirZ0y3aNUjaNCL4TH2opV__52DcZdNY Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 5ab94d9d4e204ffe9904139a9cf7c9ed Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:22:38.913573 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 5ab94d9d4e204ffe9904139a9cf7c9ed Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesActionsTest-2058611959-project Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: c2e5b1e9bab54b63af28a0c9eb295610 Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesActionsTest-2058611959-project Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. Jul 05 10:22:38.915319 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '87b84939-57f9-4b26-9014-dcf622d6aaa5'} Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:22:38.916132 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. Jul 05 10:22:38.917398 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:38.918746 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Returning 404 to user: Instance 87b84939-57f9-4b26-9014-dcf622d6aaa5 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:22:38.918746 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-473588a8-c18b-4742-bce4-c5e6169cdac6 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5" status: 404 len: 111 microversion: 2.1 time: 0.047030 Jul 05 10:22:38.918746 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 353/706] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:38 2022] GET /compute/v2.1/servers/87b84939-57f9-4b26-9014-dcf622d6aaa5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:22:38.964462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-310251057", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "b5be5a54-84fc-4271-ae8a-c420d5c3b339"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:39.016634 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] validate_networks() for [('b5be5a54-84fc-4271-ae8a-c420d5c3b339', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:22:39.366770 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:22:39.367294 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:22:39.368080 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:22:39.368486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:22:39.368885 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:22:39.378534 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:39.378976 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:39.379766 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:39.380188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:39.396684 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Getting quotas for project 5ab94d9d4e204ffe9904139a9cf7c9ed. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:22:39.400769 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Getting quotas for user c2e5b1e9bab54b63af28a0c9eb295610 and project 5ab94d9d4e204ffe9904139a9cf7c9ed. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:22:39.411814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:22:39.414013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:22:39.459847 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-17afbe8e-2b6f-4fb0-92e4-6a697ae374d5 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499680 Jul 05 10:22:39.460837 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 354/707] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:22:39.470968 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d43e3708-32dc-4bbb-b085-f5e9cf506762 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:39.471564 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d43e3708-32dc-4bbb-b085-f5e9cf506762 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:39.523305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d43e3708-32dc-4bbb-b085-f5e9cf506762 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:39.530250 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d43e3708-32dc-4bbb-b085-f5e9cf506762 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1213 microversion: 2.1 time: 0.063168 Jul 05 10:22:39.530855 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 354/708] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:39 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:40.547689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:40.548390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:40.559776 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:40.560231 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:40.561090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:40.561736 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:40.628664 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:40.636615 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5f1b3a0a-f630-4482-8cb7-744aa0b7b66a tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1283 microversion: 2.1 time: 0.093356 Jul 05 10:22:40.637190 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 355/709] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:40 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:41.654586 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:41.655212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:41.662996 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:41.663639 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:41.665015 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:41.665789 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:41.802998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:41.810785 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7586bc6c-d372-49bf-93ce-f62bf1f38384 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.160749 Jul 05 10:22:41.811358 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 355/710] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:41 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:41.918789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-7f87c489-235f-4cde-8b59-adb3ca7f4f44 req-95097731-ff9c-4aae-8f9e-df974e86da28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab486ef-7128-4433-978f-abb5acfe3bdf", "tag": "c1bbbced-956c-475b-b0db-7370c18b13b4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:41.929466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7f87c489-235f-4cde-8b59-adb3ca7f4f44 req-95097731-ff9c-4aae-8f9e-df974e86da28 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:41.929884 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-7f87c489-235f-4cde-8b59-adb3ca7f4f44 req-95097731-ff9c-4aae-8f9e-df974e86da28 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:41.942681 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-7f87c489-235f-4cde-8b59-adb3ca7f4f44 req-95097731-ff9c-4aae-8f9e-df974e86da28 service nova] Creating event network-changed:c1bbbced-956c-475b-b0db-7370c18b13b4 for instance aab486ef-7128-4433-978f-abb5acfe3bdf on hv-cinder-maste Jul 05 10:22:41.947262 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-7f87c489-235f-4cde-8b59-adb3ca7f4f44 req-95097731-ff9c-4aae-8f9e-df974e86da28 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032283 Jul 05 10:22:41.947859 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 356/711] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:42.627356 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:22:42.627631 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:22:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:22:42.828998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:42.829755 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:42.837081 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:42.837527 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:42.838329 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:42.838767 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:42.967169 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:42.975073 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-99596daf-ff5a-433b-bc40-4b9662bfb0f1 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.150074 Jul 05 10:22:42.975637 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 356/712] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:42 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:43.996405 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:43.997199 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:44.005032 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:44.005548 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:44.006475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:44.006966 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:44.149285 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:44.157605 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-de23e5fa-a6d3-402c-b333-605ebab403dc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.167848 Jul 05 10:22:44.158184 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 357/713] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:43 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:44.186168 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:44.186794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:44.195735 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:44.196316 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:44.197102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:44.197659 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:44.228671 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-be586eed-e823-4cfa-ba65-201b7fc9b4e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/ips" status: 200 len: 147 microversion: 2.1 time: 0.046616 Jul 05 10:22:44.229249 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 357/714] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:22:44 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/ips => generated 147 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:45.183131 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:45.184127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:45.195331 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:45.195973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:45.196738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:45.197173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:45.325757 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:45.333366 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-98379892-338c-44b6-80c6-702fae9388ce tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.156929 Jul 05 10:22:45.333899 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 358/715] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:45 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:46.353377 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:46.354018 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:46.363305 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:46.363875 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:46.365022 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:46.365687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:46.506014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:46.515029 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9fded52e-8fa2-4b35-b767-fe7f37a69c6c tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.167372 Jul 05 10:22:46.515678 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 358/716] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:46 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:46.903478 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0abed74b-3542-4103-9ac5-a74b4d69a660"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:46.904878 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:46.912095 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:46.912536 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:46.913296 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:46.913720 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:47.184466 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5033c701-8526-45e6-a845-8194c0512ca7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285770 Jul 05 10:22:47.185262 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 359/717] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:22:46 2022] POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:47.532725 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:47.533327 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:47.540329 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:47.540783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:47.541543 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:47.541959 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:47.681599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:47.689626 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e4d04f4f-0d7c-4106-8cfa-be27b32b6dab tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.161180 Jul 05 10:22:47.690205 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 359/718] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:47 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:48.413475 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-9b8f2653-2fc8-442d-8c79-9f28cf47c1b6 req-c252502c-5e80-4ac7-8d7c-5fa24f277d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab486ef-7128-4433-978f-abb5acfe3bdf", "name": "network-vif-plugged", "status": "completed", "tag": "c1bbbced-956c-475b-b0db-7370c18b13b4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:48.424948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9b8f2653-2fc8-442d-8c79-9f28cf47c1b6 req-c252502c-5e80-4ac7-8d7c-5fa24f277d82 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:48.425738 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-9b8f2653-2fc8-442d-8c79-9f28cf47c1b6 req-c252502c-5e80-4ac7-8d7c-5fa24f277d82 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:48.439219 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-9b8f2653-2fc8-442d-8c79-9f28cf47c1b6 req-c252502c-5e80-4ac7-8d7c-5fa24f277d82 service nova] Creating event network-vif-plugged:c1bbbced-956c-475b-b0db-7370c18b13b4 for instance aab486ef-7128-4433-978f-abb5acfe3bdf on hv-cinder-maste Jul 05 10:22:48.443861 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-9b8f2653-2fc8-442d-8c79-9f28cf47c1b6 req-c252502c-5e80-4ac7-8d7c-5fa24f277d82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034596 Jul 05 10:22:48.444614 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 360/719] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:48.708808 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:48.709374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:48.716484 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:48.716936 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:48.717705 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:48.718133 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:48.852629 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:48.860582 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e8b308b2-d7e9-448d-bb3c-576789401773 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.155709 Jul 05 10:22:48.861143 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 360/720] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:48 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:49.428032 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:49.428832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:49.433143 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c228e7fa-4c39-4d05-ba92-140fc570117c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:49.440522 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c228e7fa-4c39-4d05-ba92-140fc570117c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:49.440967 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c228e7fa-4c39-4d05-ba92-140fc570117c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:49.493930 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:49.500674 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c228e7fa-4c39-4d05-ba92-140fc570117c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Going to try to stop instance {{(pid=117864) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 10:22:49.549819 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c228e7fa-4c39-4d05-ba92-140fc570117c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action" status: 202 len: 0 microversion: 2.1 time: 0.123072 Jul 05 10:22:49.550602 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 361/721] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:22:49 2022] POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:22:49.559406 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:49.559913 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:49.561793 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:49.569893 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:49.570673 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:49.571864 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:49.572469 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:49.716166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:49.724488 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a000afcb-e548-4616-be42-3a35d751886a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.169130 Jul 05 10:22:49.725101 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 361/722] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:49 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:49.882016 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:49.883154 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:49.894585 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:49.895315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:49.896551 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:49.897254 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:50.027833 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:50.035479 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5fd87dd3-95d7-4bce-85a2-a38ab0e4a8cc tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1313 microversion: 2.1 time: 0.160680 Jul 05 10:22:50.036021 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 362/723] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:49 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:50.749063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:50.750022 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:50.760318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:50.761676 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:50.762165 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:50.762916 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:50.905049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:50.913427 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9a50b997-5ec8-40a4-b228-11753cad5069 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.170230 Jul 05 10:22:50.914007 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 362/724] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:50 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:51.057211 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:51.058208 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:51.069293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.070028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.071318 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.072064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.211806 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:51.223649 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6c9dd0c9-0da7-4bb6-a8d1-fd5820977192 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1496 microversion: 2.1 time: 0.172972 Jul 05 10:22:51.224449 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 363/725] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:51 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1496 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:51.716309 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:51.717232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:51.723452 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.723888 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.724650 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.725078 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.757908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:22:51.804658 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:51.840319 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ff2cea8b-a24b-42ce-801e-c07fe2a15598 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 204 len: 0 microversion: 2.1 time: 0.127551 Jul 05 10:22:51.841165 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 363/726] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:22:51 2022] DELETE /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:22:51.849293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:51.849870 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:51.856156 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.856590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.857350 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.857776 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.931850 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:51.932464 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:51.938845 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.939290 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.940042 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:51.940487 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:51.997315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:52.005210 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c6f4a95f-4d53-441b-836a-c096560128a7 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1502 microversion: 2.1 time: 0.160000 Jul 05 10:22:52.005796 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 364/727] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:51 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:52.078863 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:52.087692 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9364db92-37eb-47ee-81a3-a364d9583336 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.160161 Jul 05 10:22:52.088243 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 364/728] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:51 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:53.027444 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:53.028371 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:53.039447 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:53.040236 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:53.041489 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:53.042293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:53.105585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:53.106319 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:53.113341 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:53.113867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:53.114760 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:53.115265 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:53.218109 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:53.226339 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2be4881f-b387-48c9-a09c-b39d2086690d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1502 microversion: 2.1 time: 0.205590 Jul 05 10:22:53.226998 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 365/729] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:53 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:53.264785 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:53.272922 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-17afb71d-b9e9-4a6d-b601-df2e751ea768 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.171354 Jul 05 10:22:53.273501 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 365/730] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:53 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:54.014692 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-8c840b3b-ada7-48d7-aee8-613e9fe20363 req-fb1eb68b-180a-4ca4-b967-db46b286a6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab486ef-7128-4433-978f-abb5acfe3bdf", "name": "network-vif-deleted", "tag": "c1bbbced-956c-475b-b0db-7370c18b13b4"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:22:54.018358 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:54.025401 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8c840b3b-ada7-48d7-aee8-613e9fe20363 req-fb1eb68b-180a-4ca4-b967-db46b286a6c8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.025832 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-8c840b3b-ada7-48d7-aee8-613e9fe20363 req-fb1eb68b-180a-4ca4-b967-db46b286a6c8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.040758 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-8c840b3b-ada7-48d7-aee8-613e9fe20363 req-fb1eb68b-180a-4ca4-b967-db46b286a6c8 service nova] Creating event network-vif-deleted:c1bbbced-956c-475b-b0db-7370c18b13b4 for instance aab486ef-7128-4433-978f-abb5acfe3bdf on hv-cinder-maste Jul 05 10:22:54.046851 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-8c840b3b-ada7-48d7-aee8-613e9fe20363 req-fb1eb68b-180a-4ca4-b967-db46b286a6c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036288 Jul 05 10:22:54.047457 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 366/731] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:22:54.246990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:54.247600 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:54.250061 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:22:54.255757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.256234 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.256970 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.257402 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.291229 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:54.291913 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:54.292100 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.292540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.292981 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lazy-loading 'fault' on Instance uuid aab486ef-7128-4433-978f-abb5acfe3bdf {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:22:54.298809 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.299291 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.300037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:54.300466 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:54.333340 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e5b1e9bab54b63af28a0c9eb295610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ab94d9d4e204ffe9904139a9cf7c9ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:54.341924 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5e327fe1-3d20-4155-b888-34a6233d090d tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 200 len: 1303 microversion: 2.1 time: 0.100541 Jul 05 10:22:54.342542 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 366/732] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:54 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:54.435583 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:54.444068 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ec2b2e07-29d8-4f2b-ace8-5fb16c09add7 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.157046 Jul 05 10:22:54.444642 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 367/733] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:54 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:55.363948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:55.365943 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] [instance: aab486ef-7128-4433-978f-abb5acfe3bdf] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:55.377901 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:55.378721 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:55.379978 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:55.380873 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:55.397746 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] HTTP exception thrown: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Request method failure captured: Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf HTTP/1.1 Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBDdoCMV2fbkQclISWHjeuvj1yWEELXj1LusC5g8m1Jo_gQdPyeVvqU7d8HzDjO6Lacb--R2yHtuD9uoOouCnLSuaqBzaxwQDCGGNihfB3VNj5SiuCwWwwIaDz3Ye6saF0E1hvD0ADqoO3_xirZ0y3aNUjaNCL4TH2opV__52DcZdNY Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 5ab94d9d4e204ffe9904139a9cf7c9ed Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:22:55.399465 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5ab94d9d4e204ffe9904139a9cf7c9ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 5ab94d9d4e204ffe9904139a9cf7c9ed Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-VolumesActionsTest-2058611959 Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-VolumesActionsTest-2058611959-project Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: c2e5b1e9bab54b63af28a0c9eb295610 Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-VolumesActionsTest-2058611959-project Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. Jul 05 10:22:55.401231 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': 'aab486ef-7128-4433-978f-abb5acfe3bdf'} Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:22:55.402479 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. Jul 05 10:22:55.404793 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:22:55.406351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] Returning 404 to user: Instance aab486ef-7128-4433-978f-abb5acfe3bdf could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:22:55.406351 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-15c619a8-faef-433d-8df0-8d1b4a1e0451 tempest-VolumesActionsTest-2058611959 tempest-VolumesActionsTest-2058611959-project] 10.222.0.16 "GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf" status: 404 len: 111 microversion: 2.1 time: 0.043771 Jul 05 10:22:55.406351 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 367/734] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:55 2022] GET /compute/v2.1/servers/aab486ef-7128-4433-978f-abb5acfe3bdf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:22:55.461073 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:55.461760 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:55.468219 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:55.468658 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:55.469423 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:55.469848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:55.870880 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:55.878765 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d27c5c7b-a520-4806-a161-caf6e8599b74 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.421890 Jul 05 10:22:55.879326 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 368/735] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:55 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:56.900582 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:56.901689 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:56.912765 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:56.913519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:56.914843 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:56.915565 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:57.054590 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:57.063123 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fd389b01-f505-41e3-b01a-904704fdb048 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.169056 Jul 05 10:22:57.063725 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 368/736] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:56 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:58.081171 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:58.082736 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:58.090194 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:58.090925 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:58.091787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:58.092431 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:58.242582 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:58.253881 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9cf0cae7-f946-4ecc-a423-8c8f46ef1671 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.176789 Jul 05 10:22:58.254876 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 369/737] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:58 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:22:59.271441 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:22:59.272907 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:22:59.279791 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:59.280438 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:59.281398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:22:59.281830 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:22:59.436985 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:22:59.448199 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e2968097-3e37-4b29-8a62-4aa71f6feda8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.180551 Jul 05 10:22:59.448767 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 369/738] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:22:59 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:00.467804 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:00.469512 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:00.478550 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:00.479865 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:00.481625 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:00.482657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:00.635181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:00.643587 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-cacab51f-a3d4-4ed7-84e4-6c160e7fe486 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.181649 Jul 05 10:23:00.644155 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 370/739] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:00 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:01.667959 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:01.671529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:01.685986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:01.687011 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:01.688211 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:01.688638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:01.840232 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:01.848953 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-adfccb8e-a6eb-47a6-a934-b55577fb63f5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.191004 Jul 05 10:23:01.849825 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 370/740] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:01 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:02.866068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:02.867449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:02.874857 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:02.875680 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:02.876686 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:02.877151 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:03.028206 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:03.038570 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9c6b2481-ef56-4f0b-92bb-d260b9207363 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.176288 Jul 05 10:23:03.039739 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 371/741] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:02 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:04.067860 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:04.069205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:04.076546 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:04.077318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:04.078389 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:04.079013 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:04.220736 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:04.233330 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-154b7c2f-c7ab-4854-bcfb-71ff0e16f3e5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1724 microversion: 2.1 time: 0.180475 Jul 05 10:23:04.238300 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 371/742] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:04 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:05.251313 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:05.251995 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:05.258817 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:05.259255 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:05.260237 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:05.260893 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:05.419033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:05.427837 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-85bc6ccf-7e84-47d8-b589-440f9ccf53f2 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1701 microversion: 2.1 time: 0.180377 Jul 05 10:23:05.428512 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 372/743] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:05 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1701 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:05.444674 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2a41de67-6e48-43d7-bc24-cfe2d186027f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:23:05.451751 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a41de67-6e48-43d7-bc24-cfe2d186027f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:05.452560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2a41de67-6e48-43d7-bc24-cfe2d186027f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:05.514945 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2a41de67-6e48-43d7-bc24-cfe2d186027f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Going to try to start instance {{(pid=117865) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 10:23:05.561593 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2a41de67-6e48-43d7-bc24-cfe2d186027f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action" status: 202 len: 0 microversion: 2.1 time: 0.120887 Jul 05 10:23:05.562688 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 372/744] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:23:05 2022] POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:23:05.571348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:05.572088 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:05.579652 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:05.580589 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:05.581834 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:05.583099 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:05.724122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:05.732444 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e57f480d-ffb5-43a5-b708-a58856e9a967 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1710 microversion: 2.1 time: 0.165054 Jul 05 10:23:05.733457 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 373/745] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:05 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:06.756301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:06.757990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:06.770412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:06.771190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:06.772219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:06.772748 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:06.918584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:06.931163 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bbfdf263-9688-4a7d-8c2a-e60004ea4489 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1710 microversion: 2.1 time: 0.183105 Jul 05 10:23:06.932367 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 373/746] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:06 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1710 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:23:07.949092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:23:07.949876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:23:07.956939 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:07.957469 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:07.958349 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:23:07.958852 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:23:08.098015 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:23:08.106584 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fb36400b-d2f9-4e5b-87af-7fcf49971d02 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1714 microversion: 2.1 time: 0.161461 Jul 05 10:23:08.107345 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 374/747] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:23:07 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:07.068315 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=17 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:24:07.069630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:24:07.077495 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:07.078338 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:07.090516 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:07.091037 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:07.091798 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:07.092257 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:07.174588 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lazy-loading 'services' on Instance uuid 9e0bd5da-4d04-4474-93dd-ade40cad8f81 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:24:07.259722 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ec95e5c7-d568-4970-abf7-05fe9c0fc0a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments/0abed74b-3542-4103-9ac5-a74b4d69a660" status: 202 len: 0 microversion: 2.1 time: 0.194530 Jul 05 10:24:07.260360 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 374/748] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:24:07 2022] DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments/0abed74b-3542-4103-9ac5-a74b4d69a660 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:24:08.387324 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=17 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:24:08.388084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:24:08.392507 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-01eb47c8-85ce-421a-a8f8-ac34a5ab304d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:24:08.399687 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01eb47c8-85ce-421a-a8f8-ac34a5ab304d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:08.400237 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-01eb47c8-85ce-421a-a8f8-ac34a5ab304d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:08.422711 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-01eb47c8-85ce-421a-a8f8-ac34a5ab304d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Going to try to stop instance {{(pid=117864) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 05 10:24:08.467192 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-01eb47c8-85ce-421a-a8f8-ac34a5ab304d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action" status: 202 len: 0 microversion: 2.1 time: 0.081909 Jul 05 10:24:08.467803 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 375/749] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:24:08 2022] POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:24:08.477191 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:08.477917 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:08.485004 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:08.485456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:08.486549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:08.487216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:08.624633 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:08.632500 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e3919ec6-9f60-46d1-a1bd-248034900da1 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.160129 Jul 05 10:24:08.633080 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 375/750] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:08 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 05 10:24:09.654082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:09.654786 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:09.661435 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:09.661879 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:09.662665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:09.663089 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:09.798890 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:09.806538 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-52070f93-f7d6-4bda-afa3-444b2744ae88 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.159196 Jul 05 10:24:09.807079 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 376/751] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:09 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:10.834167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:10.835212 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:10.843934 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:10.844373 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:10.845128 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:10.845552 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:10.985320 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:10.993180 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5ed24617-37c3-4ada-97f7-f9ba0bf32353 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.166069 Jul 05 10:24:10.993778 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 376/752] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:10 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:12.014689 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:12.015710 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:12.026848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:12.027547 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:12.028836 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:12.029540 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:12.172090 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:12.180247 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-96f5a25f-e77c-4e7e-ad18-ce4f8610951f tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.172219 Jul 05 10:24:12.180816 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 377/753] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:12 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:13.201412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:13.202283 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:13.213490 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:13.214267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:13.215343 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:13.215770 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:13.343852 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:13.355369 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-bddf9370-d08b-4bfe-98db-5c68b0716fdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.160236 Jul 05 10:24:13.356297 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 377/754] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:13 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:14.376483 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:14.377472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:14.387606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:14.388082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:14.388853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:14.389289 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:14.422263 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:24:14.422831 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:24:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:24:14.530264 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:14.539086 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1a12cf83-0eca-475b-b0b3-a0afc7b8c931 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.168671 Jul 05 10:24:14.539845 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 378/755] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:14 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:15.561175 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:15.561865 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:15.570168 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:15.570737 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:15.571639 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:15.572154 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:15.710478 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:15.721712 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-82e40be0-81a4-45c4-b710-0157b58e3f00 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.165784 Jul 05 10:24:15.722567 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 378/756] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:15 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:16.745755 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:16.746779 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:16.757810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:16.758606 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:16.759875 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:16.760598 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:16.893341 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:16.903868 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7c82723-9678-4619-8717-4de84bca6491 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.164641 Jul 05 10:24:16.904437 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 379/757] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:16 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:17.925735 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:17.926853 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:17.937812 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:17.938627 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:17.939865 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:17.940576 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:18.080297 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:18.091478 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2dc7376c-5c79-4e5a-9705-84c3c4957077 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.172082 Jul 05 10:24:18.092051 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 379/758] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:17 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:19.114826 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:19.115641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:19.124609 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:19.125052 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:19.125802 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:19.126251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:19.262907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:19.271175 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0f0086e1-1f9d-462d-83e0-d6ef3ff8979d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.162917 Jul 05 10:24:19.271743 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 380/759] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:19 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:20.290167 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:20.290840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:20.298541 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:20.298986 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:20.299766 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:20.300189 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:20.446539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:20.455750 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d3f56eca-ffa8-459b-b808-fc4f59c7fbdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.169748 Jul 05 10:24:20.456330 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 380/760] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:20 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:21.477077 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:21.477907 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:21.488866 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:21.489696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:21.491011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:21.491726 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:21.628846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:21.639659 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-69c46aaa-eba8-4e0b-94fd-62e4db6daa91 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.169440 Jul 05 10:24:21.640234 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 381/761] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:21 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:22.660782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:22.661698 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:22.671269 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:22.671718 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:22.672481 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:22.672911 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:22.809293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:22.816842 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-003efbb2-6d3b-4cc8-ba17-ec7ec34668fd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.162485 Jul 05 10:24:22.817380 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 381/762] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:22 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:23.837648 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:23.838724 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:23.846524 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:23.847082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:23.847879 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:23.848385 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:23.988739 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:23.999516 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-679b4055-3250-4477-a251-066a0e1b9eb3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1678 microversion: 2.1 time: 0.167894 Jul 05 10:24:24.000367 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 382/763] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:23 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:25.025039 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:25.026044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:25.033771 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:25.034251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:25.035029 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:25.035473 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:25.163049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:25.175486 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5c98c8b0-40a6-4de5-b5fb-7667f0b07b63 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1655 microversion: 2.1 time: 0.156762 Jul 05 10:24:25.176314 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 382/764] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:25 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:25.195462 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-98381f57-8f57-41fd-9b13-7b752de4c7fb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:24:25.202346 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98381f57-8f57-41fd-9b13-7b752de4c7fb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:25.202813 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-98381f57-8f57-41fd-9b13-7b752de4c7fb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:25.224946 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-98381f57-8f57-41fd-9b13-7b752de4c7fb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Going to try to start instance {{(pid=117864) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 05 10:24:25.270690 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-98381f57-8f57-41fd-9b13-7b752de4c7fb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action" status: 202 len: 0 microversion: 2.1 time: 0.078870 Jul 05 10:24:25.271273 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 383/765] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:24:25 2022] POST /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:24:25.281971 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:25.282537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:25.289560 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:25.290016 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:25.290924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:25.291383 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:25.430487 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:25.438155 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f80ae20a-ec7b-4521-b0f2-1c2e8d148fe4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1664 microversion: 2.1 time: 0.160187 Jul 05 10:24:25.439037 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 383/766] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:25 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:24:26.459068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:24:26.459787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:24:26.466473 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:26.466917 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:26.467670 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:24:26.468099 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:24:26.599789 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:24:26.607504 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-56e62897-3328-4dab-bbb4-8157378d5283 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1668 microversion: 2.1 time: 0.154716 Jul 05 10:24:26.608035 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 384/767] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:24:26 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:30.082807 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=20 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:25:30.083810 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:25:30.090881 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:30.093752 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:30.103937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.104399 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.105210 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.105638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.136340 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-523d439b-f7df-457e-9968-eed548bbbcdb tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056423 Jul 05 10:25:30.136890 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 384/768] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:25:30 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:25:30.200717 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=20 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:25:30.201479 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:25:30.206163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:30.206676 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:30.213911 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.214418 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.215173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.215604 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.241429 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:25:30.321077 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d45956ae-868f-453c-b052-6a80f6d885cc tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 204 len: 0 microversion: 2.1 time: 0.121879 Jul 05 10:25:30.321683 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 385/769] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:25:30 2022] DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:25:30.331092 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:30.331647 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:30.338279 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.338726 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.339492 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:30.339957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:30.476486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:30.484655 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7f08cadd-ac4f-4a95-b02a-41f2ed6db12a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1674 microversion: 2.1 time: 0.157962 Jul 05 10:25:30.485229 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 385/770] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:30 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:31.506630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:31.507536 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:31.516766 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:31.517356 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:31.518409 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:31.518979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:31.657709 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:31.665660 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ed9f1755-a788-4be2-8409-a035ff41eeaa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1674 microversion: 2.1 time: 0.165934 Jul 05 10:25:31.666253 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 386/771] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:31 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:32.682336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:32.682959 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:32.690134 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:32.690682 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:32.691509 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:32.691954 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:32.823283 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:32.834914 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ddc9eb21-8267-44f4-a25f-746db5a43544 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1674 microversion: 2.1 time: 0.156494 Jul 05 10:25:32.835482 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 386/772] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:32 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:33.853523 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:33.854986 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:33.862158 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:33.863038 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:33.863967 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:33.864399 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:33.942369 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:33.953704 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-524973cb-073d-47b0-8492-36ae77260da9 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 200 len: 1607 microversion: 2.1 time: 0.104810 Jul 05 10:25:33.956927 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 387/773] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:33 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 1607 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:34.162563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-b4bf4c56-c3d9-43f3-9eb8-a3bf481a4de3 req-52a357aa-a02a-47db-95ca-547d295e86f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0bd5da-4d04-4474-93dd-ade40cad8f81", "name": "network-vif-deleted", "tag": "ebacc285-3d87-49cb-9bf1-0db714210c6d"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:34.170906 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b4bf4c56-c3d9-43f3-9eb8-a3bf481a4de3 req-52a357aa-a02a-47db-95ca-547d295e86f4 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:34.171388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-b4bf4c56-c3d9-43f3-9eb8-a3bf481a4de3 req-52a357aa-a02a-47db-95ca-547d295e86f4 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:34.183501 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-b4bf4c56-c3d9-43f3-9eb8-a3bf481a4de3 req-52a357aa-a02a-47db-95ca-547d295e86f4 service nova] Creating event network-vif-deleted:ebacc285-3d87-49cb-9bf1-0db714210c6d for instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 on hv-cinder-maste Jul 05 10:25:34.188866 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-b4bf4c56-c3d9-43f3-9eb8-a3bf481a4de3 req-52a357aa-a02a-47db-95ca-547d295e86f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302019 Jul 05 10:25:34.189564 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 387/774] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:34.971945 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:34.972697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:34.981079 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:34.981583 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:34.982674 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:34.983162 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:34.997169 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 HTTP/1.1 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:25:34.999003 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:25:35.000701 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '9e0bd5da-4d04-4474-93dd-ade40cad8f81'} Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:25:35.001891 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:25:35.003563 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:25:35.004848 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:25:35.004848 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-14bf4c83-0c7d-4400-bf17-a5537cd8ddfd tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 404 len: 111 microversion: 2.1 time: 0.032528 Jul 05 10:25:35.004848 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 388/775] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:34 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:25:35.015007 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-51c086d8-3471-4a69-8807-afcc5fb62d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '.version_select at 0x7ffbeafdd3a0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:35.038574 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-51c086d8-3471-4a69-8807-afcc5fb62d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590068828" status: 202 len: 0 microversion: 2.1 time: 0.032350 Jul 05 10:25:35.039202 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 388/776] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 5 10:25:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1590068828 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 05 10:25:35.668835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-74565758-e1ca-4ece-b40d-5bc4ee25e455 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: .version_select at 0x7ffbf0047430>, body: {"keypair": {"name": "tempest-keypair-1665289043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN17J5t6PWray7ZQ+NAYYdEdBybXlNxC5MEjR9pW3vj8C0quGDZXB0GbRsHYmC5Q4Xf9YGGwBypJ8tE4A4su6c+KqVhBSKhob6iZmEYMzXSCqWHL9zkgbScJ06I5t8f2lw=="}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:35.683282 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-74565758-e1ca-4ece-b40d-5bc4ee25e455 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for project 46ff9242d2b147f690786e1284d1cfef. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:25:35.687274 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-74565758-e1ca-4ece-b40d-5bc4ee25e455 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for user a895ab25adee48a3851ad15657c07a96 and project 46ff9242d2b147f690786e1284d1cfef. Resources: {'key_pairs'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:25:35.710500 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-74565758-e1ca-4ece-b40d-5bc4ee25e455 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045672 Jul 05 10:25:35.711076 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 389/777] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:37.031937 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1126059089", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af643123-9a8b-4a2b-993b-8643f71b1cf1"}], "security_groups": [{"name": "tempest-securitygroup--1273580242"}], "key_name": "tempest-keypair-1665289043", "user_data": "}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:37.160550 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] validate_networks() for [('af643123-9a8b-4a2b-993b-8643f71b1cf1', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:25:37.672529 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:25:37.672970 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:25:37.673442 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:25:37.673849 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:25:37.674307 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:25:37.683373 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:37.683825 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:37.684630 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:37.685073 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:37.702586 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for project 46ff9242d2b147f690786e1284d1cfef. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:25:37.706928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Getting quotas for user a895ab25adee48a3851ad15657c07a96 and project 46ff9242d2b147f690786e1284d1cfef. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:25:37.718115 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:25:37.720519 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:25:37.767620 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1ab04c8f-3e2b-4cb9-9e4d-0ffca8fbdedf tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.743291 Jul 05 10:25:37.768281 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 389/778] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:25:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:25:37.778732 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-32caa900-f8a5-43ed-9439-28461c4960a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:37.779341 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-32caa900-f8a5-43ed-9439-28461c4960a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:37.840369 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-32caa900-f8a5-43ed-9439-28461c4960a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:37.847222 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-32caa900-f8a5-43ed-9439-28461c4960a0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1238 microversion: 2.1 time: 0.072823 Jul 05 10:25:37.847795 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 390/779] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:37 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:38.864199 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:38.865443 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:38.873186 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:38.873918 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:38.874928 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:38.875585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:38.953243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:38.964436 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-0d9cdac2-d24e-4f08-a655-fa9a582c8f3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1298 microversion: 2.1 time: 0.104831 Jul 05 10:25:38.965234 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 390/780] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:38 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:39.981153 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:39.981735 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:39.988541 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:39.988968 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:39.989743 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:39.990174 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:40.119786 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:40.127578 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-17757ec3-ce4c-426a-bd75-5e02268d3800 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.150309 Jul 05 10:25:40.128566 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 391/781] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:39 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:40.367116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-cabe1487-3f1a-41a5-87ae-83561facb2a2 req-f409eae0-8261-4aa3-a9ab-f0eb22b26637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330307c6-dcd8-4629-b762-38595e4e819a", "tag": "0d81fac9-18ff-4f61-b0e3-d0ddac14c14c"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:40.378741 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-cabe1487-3f1a-41a5-87ae-83561facb2a2 req-f409eae0-8261-4aa3-a9ab-f0eb22b26637 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:40.379187 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-cabe1487-3f1a-41a5-87ae-83561facb2a2 req-f409eae0-8261-4aa3-a9ab-f0eb22b26637 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:40.399076 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-cabe1487-3f1a-41a5-87ae-83561facb2a2 req-f409eae0-8261-4aa3-a9ab-f0eb22b26637 service nova] Creating event network-changed:0d81fac9-18ff-4f61-b0e3-d0ddac14c14c for instance 330307c6-dcd8-4629-b762-38595e4e819a on hv-cinder-maste Jul 05 10:25:40.404357 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-cabe1487-3f1a-41a5-87ae-83561facb2a2 req-f409eae0-8261-4aa3-a9ab-f0eb22b26637 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044539 Jul 05 10:25:40.405077 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 391/782] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:41.145311 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:41.145927 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:41.153140 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:41.153597 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:41.154415 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:41.154849 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:41.292503 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:41.303440 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-2bbde291-8f2d-4547-bec0-39825b7d2887 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.161748 Jul 05 10:25:41.304067 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 392/783] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:41 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:42.331520 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:42.332662 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:42.343684 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:42.344430 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:42.345688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:42.346463 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:42.478251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:42.486253 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d317f0b4-9670-459a-81ad-450fdcc5c151 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.163005 Jul 05 10:25:42.486803 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 392/784] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:42 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:43.503851 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:43.504491 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:43.511487 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:43.511934 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:43.512704 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:43.513138 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:43.651111 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:43.658665 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8e26763a-5db3-47df-b553-d330f6b368e0 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.159132 Jul 05 10:25:43.659227 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 393/785] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:43 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:44.680346 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:44.681345 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:44.692876 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:44.693616 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:44.695071 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:44.695896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:44.840205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:44.851269 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-314805ff-3b59-4ff1-8136-75f1da61280d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.177302 Jul 05 10:25:44.852207 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 393/786] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:44 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:45.206165 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-585f2680-459a-4d9a-950d-3f1b15da62be req-74919f22-ff4f-42d4-8f63-6654c675c3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330307c6-dcd8-4629-b762-38595e4e819a", "name": "network-vif-plugged", "status": "completed", "tag": "0d81fac9-18ff-4f61-b0e3-d0ddac14c14c"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:45.215086 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-585f2680-459a-4d9a-950d-3f1b15da62be req-74919f22-ff4f-42d4-8f63-6654c675c3d3 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:45.215530 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-585f2680-459a-4d9a-950d-3f1b15da62be req-74919f22-ff4f-42d4-8f63-6654c675c3d3 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:45.226601 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-585f2680-459a-4d9a-950d-3f1b15da62be req-74919f22-ff4f-42d4-8f63-6654c675c3d3 service nova] Creating event network-vif-plugged:0d81fac9-18ff-4f61-b0e3-d0ddac14c14c for instance 330307c6-dcd8-4629-b762-38595e4e819a on hv-cinder-maste Jul 05 10:25:45.232240 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-585f2680-459a-4d9a-950d-3f1b15da62be req-74919f22-ff4f-42d4-8f63-6654c675c3d3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111471 Jul 05 10:25:45.232915 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 394/787] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:45.877794 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:45.878845 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:45.890048 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:45.890833 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:45.892088 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:45.892791 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:46.027296 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:46.036705 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e24ecdfa-c95d-45b7-9021-0da5278ed3d8 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1364 microversion: 2.1 time: 0.165361 Jul 05 10:25:46.037405 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 394/788] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:45 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:47.060853 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:47.062017 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:47.072329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:47.072774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:47.073527 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:47.073955 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:47.210852 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:25:47.219743 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-12a67985-f3b7-4bd5-bca7-21d7cdf78f3d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1550 microversion: 2.1 time: 0.166977 Jul 05 10:25:47.220316 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 395/789] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:25:47 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:25:47.237244 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:25:47.237816 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:25:47.244786 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:47.245310 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:47.246086 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:47.246543 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:47.324631 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c8ed5b37-f04b-4eec-b5b4-add92e4386aa tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091875 Jul 05 10:25:47.325431 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 395/790] 10.222.0.16 () {58 vars in 1274 bytes} [Tue Jul 5 10:25:47 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:48.518713 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=6 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:25:48.571102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-950f7d60-fece-43e1-8cf5-65160694bf44 req-0d592f01-97c9-4e36-82d8-72e06babd917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330307c6-dcd8-4629-b762-38595e4e819a", "tag": "0d81fac9-18ff-4f61-b0e3-d0ddac14c14c"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:25:48.579115 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-950f7d60-fece-43e1-8cf5-65160694bf44 req-0d592f01-97c9-4e36-82d8-72e06babd917 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:25:48.579556 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-950f7d60-fece-43e1-8cf5-65160694bf44 req-0d592f01-97c9-4e36-82d8-72e06babd917 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:25:48.590642 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-950f7d60-fece-43e1-8cf5-65160694bf44 req-0d592f01-97c9-4e36-82d8-72e06babd917 service nova] Creating event network-changed:0d81fac9-18ff-4f61-b0e3-d0ddac14c14c for instance 330307c6-dcd8-4629-b762-38595e4e819a on hv-cinder-maste Jul 05 10:25:48.595694 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-950f7d60-fece-43e1-8cf5-65160694bf44 req-0d592f01-97c9-4e36-82d8-72e06babd917 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081398 Jul 05 10:25:48.596227 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 396/791] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:25:54.691617 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:25:54.691617 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:25:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:27:03.359398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:03.360540 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:03.363079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:03.364169 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=52 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:03.450179 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:03.450715 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:03.457652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:03.458112 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:03.458920 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:03.459360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:03.483127 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6de58c20-f216-4090-8410-9a510a9fa876 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/ips" status: 200 len: 146 microversion: 2.1 time: 0.126007 Jul 05 10:27:03.483668 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 396/792] 10.222.0.16 () {58 vars in 1247 bytes} [Tue Jul 5 10:27:03 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/ips => generated 146 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:04.832481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:04.833224 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:04.837947 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b367adf-a81a-49e3-a750-5c8f55fe84c0"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:04.839102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:04.847943 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:04.848387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:04.849135 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:04.849557 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:05.141943 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-22e3df66-6139-4f81-8690-1a72ef4d7254 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311487 Jul 05 10:27:05.142787 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 397/793] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:27:04 2022] POST /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:07.390436 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:07.391427 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:07.398380 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:07.398831 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:07.399595 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:07.400028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:07.429942 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-70c9d4cf-fe9b-4c93-889e-49d23769ec8c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Jul 05 10:27:07.430538 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 397/794] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:27:07 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:07.441031 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:07.441582 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:07.448985 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:07.449432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:07.450206 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:07.450664 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:07.481079 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5247d142-3ff2-42ce-aff1-1ad63bb30814 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0" status: 200 len: 194 microversion: 2.1 time: 0.044410 Jul 05 10:27:07.481791 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 398/795] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 5 10:27:07 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:08.816616 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4297db4-59e8-4252-82a1-9f4b27dafe58"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:08.817668 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:08.824398 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:08.824841 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:08.825587 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:08.826018 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:09.104596 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-dd3d27f3-e763-46e4-a8f2-81178e970d0d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "POST /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291813 Jul 05 10:27:09.105198 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 398/796] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:27:08 2022] POST /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:11.364520 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:11.365519 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:11.372496 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.372942 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.373696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.374121 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.404047 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a855adc9-18fc-4b4d-a389-3ec303f386a3 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043661 Jul 05 10:27:11.404588 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 399/797] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:27:11 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:11.559306 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:11.560260 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:11.569713 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.570237 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.571038 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.571477 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.601916 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a4261f0d-897c-433d-ae30-5e4e2862213d tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0" status: 200 len: 194 microversion: 2.1 time: 0.050720 Jul 05 10:27:11.602539 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 399/798] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 5 10:27:11 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:11.612790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:11.613279 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:11.619840 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.620207 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.620962 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:11.621392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:11.703177 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lazy-loading 'services' on Instance uuid 330307c6-dcd8-4629-b762-38595e4e819a {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:27:11.780197 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-00f12cbf-7faa-4fcc-b134-ef45b8e26021 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0" status: 202 len: 0 microversion: 2.1 time: 0.171384 Jul 05 10:27:11.780796 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 400/799] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:27:11 2022] DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/3b367adf-a81a-49e3-a750-5c8f55fe84c0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:27:13.963585 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:13.964131 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:13.971005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:13.971448 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:13.972198 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:13.972624 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:14.003634 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ada73e05-32be-487f-9594-c0e3fa18e589 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/c4297db4-59e8-4252-82a1-9f4b27dafe58" status: 200 len: 194 microversion: 2.1 time: 0.044101 Jul 05 10:27:14.004210 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 400/800] 10.222.0.16 () {58 vars in 1412 bytes} [Tue Jul 5 10:27:13 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/c4297db4-59e8-4252-82a1-9f4b27dafe58 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:14.017501 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:14.018013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:14.024949 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:14.025392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:14.026152 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:14.026614 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:14.107912 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lazy-loading 'services' on Instance uuid 330307c6-dcd8-4629-b762-38595e4e819a {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:27:14.182299 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-daafd320-97a9-4029-b93e-8d4b77026c78 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/c4297db4-59e8-4252-82a1-9f4b27dafe58" status: 202 len: 0 microversion: 2.1 time: 0.169533 Jul 05 10:27:14.182872 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 401/801] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:27:14 2022] DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments/c4297db4-59e8-4252-82a1-9f4b27dafe58 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:27:15.364817 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:15.365921 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:15.373760 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.374580 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.375543 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.376062 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.406121 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e5dcb13f-b239-4bdb-b3d9-46c69b7b4132 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046752 Jul 05 10:27:15.406703 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 401/802] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:27:15 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:27:15.510774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:15.511782 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:15.518708 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.519168 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.519932 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.520332 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.548759 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7082a7f6-1b64-4adc-a3f0-f494c8b89a3a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042273 Jul 05 10:27:15.549309 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 402/803] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:27:15 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:27:15.617117 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:15.617605 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:15.623752 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.624208 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.624957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.625382 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.649742 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:27:15.753281 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-70ddb7f5-e377-4170-bb76-97664faa4140 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 204 len: 0 microversion: 2.1 time: 0.139745 Jul 05 10:27:15.754120 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 402/804] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:27:15 2022] DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:27:15.762574 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:15.763497 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:15.769599 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.770043 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.770821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:15.771238 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:15.905041 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:15.913064 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-08a51707-30a6-4727-bd27-fdfc8fb0fbd5 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1675 microversion: 2.1 time: 0.154448 Jul 05 10:27:15.913626 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 403/805] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:15 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:16.936316 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:16.937456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:16.948422 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:16.949214 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:16.950494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:16.951252 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:17.102811 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:17.110884 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-3f7349d4-72c6-4bb3-9703-4da56de2f037 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1675 microversion: 2.1 time: 0.181683 Jul 05 10:27:17.111463 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 403/806] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:16 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:18.132846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:18.133721 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:18.144645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:18.145372 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:18.146663 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:18.147372 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:18.290062 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:18.297679 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bb6f0619-74d3-4d4d-bfc7-c3da7a4dea3c tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1675 microversion: 2.1 time: 0.171581 Jul 05 10:27:18.298205 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:18 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:19.315757 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:19.316301 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:19.323464 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:19.323909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:19.324688 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:19.325201 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:19.388549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a895ab25adee48a3851ad15657c07a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46ff9242d2b147f690786e1284d1cfef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:19.396215 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fcbe2981-a23a-4ffd-9622-4b7d759e73ce tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 200 len: 1607 microversion: 2.1 time: 0.084964 Jul 05 10:27:19.396792 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 404/808] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:19 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:19.499734 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-ff6a8bba-2b30-415d-9c39-3b3679b825e2 req-c5fe5f1f-efe1-4620-8488-bba37d809c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330307c6-dcd8-4629-b762-38595e4e819a", "name": "network-vif-deleted", "tag": "0d81fac9-18ff-4f61-b0e3-d0ddac14c14c"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:19.509767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ff6a8bba-2b30-415d-9c39-3b3679b825e2 req-c5fe5f1f-efe1-4620-8488-bba37d809c34 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:19.510209 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-ff6a8bba-2b30-415d-9c39-3b3679b825e2 req-c5fe5f1f-efe1-4620-8488-bba37d809c34 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:19.521480 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-ff6a8bba-2b30-415d-9c39-3b3679b825e2 req-c5fe5f1f-efe1-4620-8488-bba37d809c34 service nova] Creating event network-vif-deleted:0d81fac9-18ff-4f61-b0e3-d0ddac14c14c for instance 330307c6-dcd8-4629-b762-38595e4e819a on hv-cinder-maste Jul 05 10:27:19.526560 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-ff6a8bba-2b30-415d-9c39-3b3679b825e2 req-c5fe5f1f-efe1-4620-8488-bba37d809c34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Jul 05 10:27:19.527679 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 405/809] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:20.414444 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:20.415126 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:20.424010 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:20.424456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:20.425247 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:20.425678 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:20.441662 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a HTTP/1.1 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:27:20.443577 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:20.445236 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '330307c6-dcd8-4629-b762-38595e4e819a'} Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:27:20.446075 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:20.447556 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:20.448728 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:27:20.448728 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b400dbd9-41b9-41a8-a05b-83f5db4b8f2a tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 404 len: 111 microversion: 2.1 time: 0.035226 Jul 05 10:27:20.448728 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 405/810] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:20 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:27:20.455400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8d234b21-6f18-49cb-9f56-b7235b7681da tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '.version_select at 0x7ffbeafd3160>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:20.478343 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8d234b21-6f18-49cb-9f56-b7235b7681da tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665289043" status: 202 len: 0 microversion: 2.1 time: 0.027590 Jul 05 10:27:20.478928 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 406/811] 10.222.0.16 () {58 vars in 1220 bytes} [Tue Jul 5 10:27:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1665289043 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:27:23.461439 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:23.461966 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:23.468844 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:23.469293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:23.470057 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:23.470528 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:23.484247 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a HTTP/1.1 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:27:23.485826 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.487413 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '330307c6-dcd8-4629-b762-38595e4e819a'} Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:27:23.488401 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.489880 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.491576 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:27:23.491576 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2cd13ca5-acc2-4ccc-8d0d-3a781b1475ba tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 404 len: 111 microversion: 2.1 time: 0.029844 Jul 05 10:27:23.491576 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 406/812] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:27:23 2022] DELETE /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:27:23.496264 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:23.496998 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 330307c6-dcd8-4629-b762-38595e4e819a] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:23.503403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:23.503851 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:23.504602 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:23.505043 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:23.518287 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a HTTP/1.1 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:27:23.519896 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.521422 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '330307c6-dcd8-4629-b762-38595e4e819a'} Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:27:23.522421 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. Jul 05 10:27:23.524016 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:23.525449 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 330307c6-dcd8-4629-b762-38595e4e819a could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:27:23.525449 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-51c826a9-349a-4344-a6b1-18fe059b55d4 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a" status: 404 len: 111 microversion: 2.1 time: 0.029393 Jul 05 10:27:23.525449 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 407/813] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:23 2022] GET /compute/v2.1/servers/330307c6-dcd8-4629-b762-38595e4e819a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:27:24.681415 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:24.681948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:24.688897 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:24.689341 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:24.690102 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:24.690568 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:24.704744 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.wsgi [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: request: DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 HTTP/1.1 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept: application/json Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Accept-Encoding: identity Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Connection: close Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Length: 0 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Content-Type: application/json Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Host: 10.222.0.16 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: Openstack-System-Scope: None Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: User-Agent: python-urllib3/1.26.9 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Id: None Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Domain-Name: None Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Identity-Status: Confirmed Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Is-Admin-Project: True Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Id: default Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Domain-Name: Default Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Role: member,reader Jul 05 10:27:24.706457 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Roles: member,reader Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Id: default Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Domain-Name: Default Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: method: > Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: exception: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.708069 dv-cinder-master-3-smb devstack@n-api.service[117865]: action_args: {'id': '9e0bd5da-4d04-4474-93dd-ade40cad8f81'} Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:27:24.708814 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.710002 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.711932 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. {{(pid=117865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:27:24.711932 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-09ce126d-b79b-4d39-887e-26388b9de657 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 404 len: 111 microversion: 2.1 time: 0.030403 Jul 05 10:27:24.711932 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 407/814] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:27:24 2022] DELETE /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:27:24.716489 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:24.717102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] [instance: 9e0bd5da-4d04-4474-93dd-ade40cad8f81] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:24.724144 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:24.724623 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:24.725407 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:24.725829 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:24.739606 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] HTTP exception thrown: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Request method failure captured: Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 HTTP/1.1 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBCa2s3YZWi-ccV1edm155R9cz_xfACd7eA7WlTkozkjWyo4V0C-7dQ8P72VbAqFP0Ab1TEU2yUpTOzhZ-n4eojrT5NYFkrz-y8WcNPS61ph7C2wLg9Ykb9c8ApLOzSZTQccl9Ni14IiCkCCIrTxH3SiDrO9whiogUWBrdhMuM5ZyX0 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:27:24.741110 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/46ff9242d2b147f690786e1284d1cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 46ff9242d2b147f690786e1284d1cfef Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1367725490 Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: a895ab25adee48a3851ad15657c07a96 Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-AttachVolumeTestJSON-1367725490-project Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.742839 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '9e0bd5da-4d04-4474-93dd-ade40cad8f81'} Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:27:24.743763 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. Jul 05 10:27:24.745175 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:27:24.746625 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] Returning 404 to user: Instance 9e0bd5da-4d04-4474-93dd-ade40cad8f81 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:27:24.746625 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-a6809a23-2562-480d-ab64-a23bccb89d46 tempest-AttachVolumeTestJSON-1367725490 tempest-AttachVolumeTestJSON-1367725490-project] 10.222.0.16 "GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81" status: 404 len: 111 microversion: 2.1 time: 0.029960 Jul 05 10:27:24.746625 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 408/815] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:24 2022] GET /compute/v2.1/servers/9e0bd5da-4d04-4474-93dd-ade40cad8f81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:27:42.638905 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:27:42.639441 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:27:50.545848 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-624574094", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "b9befa43-b3ba-48fc-8889-e9d977efd765"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:50.553098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:50.553785 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:50.793155 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] validate_networks() for [('b9befa43-b3ba-48fc-8889-e9d977efd765', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:27:51.162262 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:27:51.162671 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:27:51.163135 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:27:51.163535 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:27:51.163939 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:27:51.173492 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:51.173938 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:51.174783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:51.175213 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:51.192654 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Getting quotas for project dccedf0b40e94111bf3b31f9347dfa44. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:27:51.196994 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Getting quotas for user 7715154f39dc457695d5991dac30e107 and project dccedf0b40e94111bf3b31f9347dfa44. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:27:51.209465 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:27:51.211725 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:27:51.256255 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-2888c072-b236-4457-9c55-41d30c7d60ff tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714242 Jul 05 10:27:51.256915 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 408/816] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:27:51.267280 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-988f48fc-00e8-4711-9e3b-ab77fb3b2715 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:51.267953 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-988f48fc-00e8-4711-9e3b-ab77fb3b2715 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:51.270416 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:51.271855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:27:51.383452 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-988f48fc-00e8-4711-9e3b-ab77fb3b2715 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:51.390385 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-988f48fc-00e8-4711-9e3b-ab77fb3b2715 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1218 microversion: 2.1 time: 0.127146 Jul 05 10:27:51.390952 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 409/817] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:51 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:52.408098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:52.408702 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:52.415720 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:52.416050 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:52.417016 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:52.417447 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:52.480359 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:52.488283 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-80458cf5-483a-4451-b6ec-4373d1c88244 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1276 microversion: 2.1 time: 0.084608 Jul 05 10:27:52.489007 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 409/818] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:52 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:53.505433 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:53.506098 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:53.513960 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:53.514473 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:53.515235 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:53.515659 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:53.649974 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:53.657586 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-392f71d1-df1b-41de-9902-96372d208968 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.156248 Jul 05 10:27:53.658148 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 410/819] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:53 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:53.848577 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-fe9d4e43-96cf-481e-b09b-665588ee115b req-3706f03c-bf73-4154-891b-d54e284e064b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6851f89f-4abd-459c-98c0-baf707770970", "tag": "92c99ca2-733e-4a1e-9ce9-1b42a0511860"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:53.858092 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fe9d4e43-96cf-481e-b09b-665588ee115b req-3706f03c-bf73-4154-891b-d54e284e064b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:53.858819 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-fe9d4e43-96cf-481e-b09b-665588ee115b req-3706f03c-bf73-4154-891b-d54e284e064b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:53.870761 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-fe9d4e43-96cf-481e-b09b-665588ee115b req-3706f03c-bf73-4154-891b-d54e284e064b service nova] Creating event network-changed:92c99ca2-733e-4a1e-9ce9-1b42a0511860 for instance 6851f89f-4abd-459c-98c0-baf707770970 on hv-cinder-maste Jul 05 10:27:53.875857 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-fe9d4e43-96cf-481e-b09b-665588ee115b req-3706f03c-bf73-4154-891b-d54e284e064b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031240 Jul 05 10:27:53.876469 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 410/820] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:27:54.677697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:54.678695 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:54.688734 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:54.689188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:54.689952 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:54.690428 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:54.822122 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:54.830508 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5c408263-f829-4644-a687-16f7286924f3 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.159099 Jul 05 10:27:54.831073 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 411/821] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:54 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:55.853460 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:55.854643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:55.863351 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:55.863800 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:55.864570 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:55.865000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:56.008280 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:56.016434 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-71e869ae-1278-46e8-b7ef-c71a72cd2df8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.170633 Jul 05 10:27:56.016901 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 411/822] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:55 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:57.033692 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:57.034276 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:57.041219 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:57.041694 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:57.042502 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:57.042933 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:57.176855 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:57.184752 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-80c49c9c-6aee-4c7d-b12b-b180b793bd83 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.155423 Jul 05 10:27:57.185303 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 412/823] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:57 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:58.203359 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:58.204073 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:58.211007 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:58.211378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:58.212136 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:58.212592 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:58.354870 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:58.363029 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6421abf9-34a2-477f-aab0-27fa90c041a9 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.164026 Jul 05 10:27:58.363628 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 412/824] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:58 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:59.384450 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:27:59.385532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:27:59.396589 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:59.397367 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:59.398647 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:59.399403 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:59.536013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:27:59.543993 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8c9f0d4c-1562-41f5-a5e0-27d37b178918 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.166169 Jul 05 10:27:59.544566 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 413/825] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:27:59 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:27:59.888420 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-659fd5cd-ae7f-4ceb-8f5d-ff540e30999c req-e74fa5ab-38c7-4330-a1a5-c2ce4bf0377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6851f89f-4abd-459c-98c0-baf707770970", "name": "network-vif-plugged", "status": "completed", "tag": "92c99ca2-733e-4a1e-9ce9-1b42a0511860"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:27:59.897060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-659fd5cd-ae7f-4ceb-8f5d-ff540e30999c req-e74fa5ab-38c7-4330-a1a5-c2ce4bf0377f service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:27:59.897488 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-659fd5cd-ae7f-4ceb-8f5d-ff540e30999c req-e74fa5ab-38c7-4330-a1a5-c2ce4bf0377f service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:27:59.909105 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-659fd5cd-ae7f-4ceb-8f5d-ff540e30999c req-e74fa5ab-38c7-4330-a1a5-c2ce4bf0377f service nova] Creating event network-vif-plugged:92c99ca2-733e-4a1e-9ce9-1b42a0511860 for instance 6851f89f-4abd-459c-98c0-baf707770970 on hv-cinder-maste Jul 05 10:27:59.913947 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-659fd5cd-ae7f-4ceb-8f5d-ff540e30999c req-e74fa5ab-38c7-4330-a1a5-c2ce4bf0377f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Jul 05 10:27:59.914577 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 413/826] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:28:00.565390 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:00.566416 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:00.577784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:00.578579 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:00.579835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:00.580533 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:00.717993 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:00.725904 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-655a62a3-ea44-40c0-ae57-4804d928b173 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1318 microversion: 2.1 time: 0.167062 Jul 05 10:28:00.726509 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 414/827] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:00 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:01.741814 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:01.742844 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:01.748059 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:01.748846 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:01.757483 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:01.758003 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:01.758949 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:01.759455 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:01.896343 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:01.904200 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-5a7aa3a6-7185-45b0-a9e6-0d42d3498452 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1508 microversion: 2.1 time: 0.164117 Jul 05 10:28:01.904766 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 414/828] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:01 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:20.305009 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0de69fc-222a-441c-a799-7f561d1637e9", "device": "/dev/sdb"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:28:20.306638 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:20.308773 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:20.309505 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=14 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:20.310127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=30 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:20.316037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:20.316484 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:20.317247 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:20.317683 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:20.596375 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ba26696f-1328-45f0-9d4f-c9e67fbbb92d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "POST /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295792 Jul 05 10:28:20.597025 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 415/829] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:28:20 2022] POST /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:28:23.476782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:23.477647 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=30 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:23.527601 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0de69fc-222a-441c-a799-7f561d1637e9", "create_info": {"type": "qcow2", "new_file": "volume-a0de69fc-222a-441c-a799-7f561d1637e9.4e7bf921-d245-4833-82a5-cc071e5b8e00.vhdx", "snapshot_id": "4e7bf921-d245-4833-82a5-cc071e5b8e00"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:28:23.534378 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=117865) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 05 10:28:23.534922 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:23.535357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:23.578260 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:23.578737 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:23.601989 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-747fb954-3827-4752-b09e-f92350dc2d79 req-d3d9eb54-6061-4c19-a19a-00dc61a52f4e admin admin] 10.222.0.39 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.133013 Jul 05 10:28:23.602843 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 415/830] 10.222.0.39 () {64 vars in 1326 bytes} [Tue Jul 5 10:28:23 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:28:27.609645 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0de69fc-222a-441c-a799-7f561d1637e9", "create_info": {"type": "qcow2", "new_file": "volume-a0de69fc-222a-441c-a799-7f561d1637e9.e7dee0bc-9a25-48d5-ac73-167118aa78b6.vhdx", "snapshot_id": "e7dee0bc-9a25-48d5-ac73-167118aa78b6"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:28:27.617210 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),32bbf915-3f68-4e1d-9859-941f6a1419ac(cell1) {{(pid=117864) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 05 10:28:27.617784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:27.618237 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:27.656181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:27.656628 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:27.679332 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-c5ee2104-86f1-489c-ae9f-8b4e6dcbc289 req-7bce2468-cc2b-4367-9eb6-478729ef0a6d admin admin] 10.222.0.39 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.145883 Jul 05 10:28:27.679986 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 416/831] 10.222.0.39 () {64 vars in 1326 bytes} [Tue Jul 5 10:28:27 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:28:37.005606 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:37.006401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:37.007060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:37.061509 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "a0de69fc-222a-441c-a799-7f561d1637e9", "create_info": {"type": "qcow2", "new_file": "volume-a0de69fc-222a-441c-a799-7f561d1637e9.4dfa3db7-4447-439b-b886-7ab2a27148f3.vhdx", "snapshot_id": "4dfa3db7-4447-439b-b886-7ab2a27148f3"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:28:37.063539 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:37.063979 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:37.072496 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:37.072935 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:37.087746 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-4ad12914-388f-4f6e-b888-4aab439e5d06 req-3d43b2e9-b74a-4a19-b4a8-a1edcf717284 admin admin] 10.222.0.39 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.083307 Jul 05 10:28:37.088541 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 416/832] 10.222.0.39 () {64 vars in 1326 bytes} [Tue Jul 5 10:28:37 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:28:40.129493 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:40.130251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:40.130896 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:40.183400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:40.185412 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:40.185845 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:40.194413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:40.194846 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:40.209786 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-76764c62-d932-49ca-b60f-8e6fd0021544 req-00a4cbdd-f12f-4b9e-b1d4-b0ed8ab250ca admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/4e7bf921-d245-4833-82a5-cc071e5b8e00?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.4e7bf921-d245-4833-82a5-cc071e5b8e00.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.081473 Jul 05 10:28:40.210381 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 417/833] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:28:40 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/4e7bf921-d245-4833-82a5-cc071e5b8e00?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.4e7bf921-d245-4833-82a5-cc071e5b8e00.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:28:44.426166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:44.428205 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:44.428643 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:44.437412 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:44.437857 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:44.451633 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-e9cdacd8-6766-4f90-ad60-6156363e603b req-832554f1-3687-4434-be49-3a9f5350aa53 admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/4dfa3db7-4447-439b-b886-7ab2a27148f3?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.4dfa3db7-4447-439b-b886-7ab2a27148f3.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079015 Jul 05 10:28:44.452193 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 417/834] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:28:44 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/4dfa3db7-4447-439b-b886-7ab2a27148f3?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.4dfa3db7-4447-439b-b886-7ab2a27148f3.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:28:47.606739 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:47.608734 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:47.609221 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:47.617717 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:47.618165 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:47.631684 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-108b31eb-ada4-4cae-92c7-7e100b7df8aa req-9133e5d8-3973-42b1-ab6d-9aeb1fcefdd0 admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/e7dee0bc-9a25-48d5-ac73-167118aa78b6?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.e7dee0bc-9a25-48d5-ac73-167118aa78b6.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.085233 Jul 05 10:28:47.632309 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 418/835] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:28:47 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/e7dee0bc-9a25-48d5-ac73-167118aa78b6?delete_info=%7B%22file_to_merge%22:%20%22volume-a0de69fc-222a-441c-a799-7f561d1637e9.e7dee0bc-9a25-48d5-ac73-167118aa78b6.vhdx%22,%20%22volume_id%22:%20%22a0de69fc-222a-441c-a799-7f561d1637e9%22%7D => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:28:50.568617 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:50.569173 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:50.578943 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:50.579386 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:50.580146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:50.580573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:50.673695 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lazy-loading 'services' on Instance uuid 6851f89f-4abd-459c-98c0-baf707770970 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:28:50.752267 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d9553dc3-aed9-40e8-b09a-06c977e3d519 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970/os-volume_attachments/a0de69fc-222a-441c-a799-7f561d1637e9" status: 202 len: 0 microversion: 2.1 time: 0.191125 Jul 05 10:28:50.753184 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 418/836] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:28:50 2022] DELETE /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970/os-volume_attachments/a0de69fc-222a-441c-a799-7f561d1637e9 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:28:51.880761 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:51.881315 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:51.887740 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:51.888188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:51.888948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:51.889351 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:51.914378 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Going to try to terminate instance {{(pid=117864) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:28:51.994912 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1f84029d-9199-4499-b4e4-935d28ceb907 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 204 len: 0 microversion: 2.1 time: 0.118511 Jul 05 10:28:51.995608 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 419/837] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:28:51 2022] DELETE /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:28:52.006360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:52.007060 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:52.013573 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:52.014033 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:52.014834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:52.015274 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:52.148360 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:52.160222 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-507f3cb0-e92d-461d-af6c-47322df21268 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1514 microversion: 2.1 time: 0.158652 Jul 05 10:28:52.161194 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 419/838] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:51 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:53.187448 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:53.188583 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:53.200064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:53.200799 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:53.202040 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:53.202810 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:53.347748 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:53.356134 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-fb2cdfd4-1af7-4202-9ef7-09176d5c1839 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1514 microversion: 2.1 time: 0.175768 Jul 05 10:28:53.356711 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 420/839] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:53 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:54.377160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:54.378165 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:54.386648 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:54.387098 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:54.387859 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:54.388293 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:54.432359 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=4 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:54.535235 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:54.546626 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-7729a2a9-d255-4927-821e-42f8e4e4ab32 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1514 microversion: 2.1 time: 0.175719 Jul 05 10:28:54.547420 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 420/840] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:54 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:55.570590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:55.571508 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:55.583087 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:55.583799 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:55.585037 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:55.585587 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:55.724179 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:55.732099 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3ae9e87c-64be-451b-91f2-88641f043dfc tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1514 microversion: 2.1 time: 0.168087 Jul 05 10:28:55.732698 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 421/841] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:55 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:56.751140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:56.751886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:56.761258 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:56.761840 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:56.762659 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:56.763122 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:56.899494 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:56.907111 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4a01705a-bd34-4e5d-8ccd-9d979dbfb3f0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1514 microversion: 2.1 time: 0.161023 Jul 05 10:28:56.907680 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 421/842] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:56 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:57.766051 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-3162b2f3-5379-4d41-a986-35469b2196e7 req-8661224d-d31a-4dcf-8aff-a0a87f62873f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6851f89f-4abd-459c-98c0-baf707770970", "name": "network-vif-deleted", "tag": "92c99ca2-733e-4a1e-9ce9-1b42a0511860"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:28:57.771460 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:28:57.779413 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3162b2f3-5379-4d41-a986-35469b2196e7 req-8661224d-d31a-4dcf-8aff-a0a87f62873f service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:57.779857 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3162b2f3-5379-4d41-a986-35469b2196e7 req-8661224d-d31a-4dcf-8aff-a0a87f62873f service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:57.792712 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-3162b2f3-5379-4d41-a986-35469b2196e7 req-8661224d-d31a-4dcf-8aff-a0a87f62873f service nova] Creating event network-vif-deleted:92c99ca2-733e-4a1e-9ce9-1b42a0511860 for instance 6851f89f-4abd-459c-98c0-baf707770970 on hv-cinder-maste Jul 05 10:28:57.797960 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-3162b2f3-5379-4d41-a986-35469b2196e7 req-8661224d-d31a-4dcf-8aff-a0a87f62873f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035836 Jul 05 10:28:57.799065 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 422/843] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:28:57.925082 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:57.925719 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:57.933797 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:57.935051 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:57.936157 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:57.936619 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:57.967957 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:57.968408 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:57.968854 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.objects.instance [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lazy-loading 'fault' on Instance uuid 6851f89f-4abd-459c-98c0-baf707770970 {{(pid=117865) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:28:58.018738 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:28:58.026409 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8c91ffd6-33e7-445c-8c38-e4665e4ee9bf tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 200 len: 1308 microversion: 2.1 time: 0.105251 Jul 05 10:28:58.026981 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 422/844] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:57 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:28:59.048737 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:28:59.049678 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: 6851f89f-4abd-459c-98c0-baf707770970] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:28:59.059570 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:59.060013 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:59.060762 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:28:59.061187 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:28:59.074976 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] HTTP exception thrown: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Request method failure captured: Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 HTTP/1.1 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBIkm2EMA5QkzYe1Li4GCqH2tjwmcsDLqS-1u_1IgUWMyaAHrB9W48Vr_4wVsbPEFmo7XnEAK9lE4nETNKCmKHDg13CTrJqG0XhSQyMT9J8aQrjU-2ToeNzPkeoUV43v4gezUzFUVlce2NP8IBQeYG8YHl8H1qcpjLh1-Q9LcoFbXVg Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: dccedf0b40e94111bf3b31f9347dfa44 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:28:59.076584 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: dccedf0b40e94111bf3b31f9347dfa44 Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesSnapshotTestJSON-127185397-project Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 7715154f39dc457695d5991dac30e107 Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesSnapshotTestJSON-127185397-project Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. Jul 05 10:28:59.078107 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '6851f89f-4abd-459c-98c0-baf707770970'} Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:28:59.079295 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. Jul 05 10:28:59.080625 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:28:59.082033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Returning 404 to user: Instance 6851f89f-4abd-459c-98c0-baf707770970 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:28:59.082033 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7d2261ad-6d9f-433a-a6d2-b06fb4d2342b tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970" status: 404 len: 111 microversion: 2.1 time: 0.036449 Jul 05 10:28:59.082033 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 423/845] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:28:59 2022] GET /compute/v2.1/servers/6851f89f-4abd-459c-98c0-baf707770970 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:29:02.790252 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-715823622", "imageRef": "39dad39b-3ebd-40cb-b604-a3b05b761120", "flavorRef": "452", "networks": [{"uuid": "b9befa43-b3ba-48fc-8889-e9d977efd765"}]}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:02.847373 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.network.neutron [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] validate_networks() for [('b9befa43-b3ba-48fc-8889-e9d977efd765', None, None, None, None, None)] {{(pid=117865) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:29:03.205542 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Flavor limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:29:03.206113 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Image limits 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:29:03.206924 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Flavor pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:29:03.207486 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Image pref 0:0:0 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:29:03.208044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.virt.hardware [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117865) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:29:03.220320 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:03.220700 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:03.221499 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:03.221967 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:03.239322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Getting quotas for project dccedf0b40e94111bf3b31f9347dfa44. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:29:03.243638 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Getting quotas for user 7715154f39dc457695d5991dac30e107 and project dccedf0b40e94111bf3b31f9347dfa44. Resources: {'instances', 'ram', 'cores'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:29:03.255709 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Going to run 1 instances... {{(pid=117865) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:29:03.257953 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='39dad39b-3ebd-40cb-b604-a3b05b761120',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117865) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:29:03.306157 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-77c93c56-7b29-4122-b8e6-5150a453da4d tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519813 Jul 05 10:29:03.306840 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 423/846] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:29:03.317092 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-79c77815-d1b8-4807-b9c0-f0119d5568b0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:03.317656 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-79c77815-d1b8-4807-b9c0-f0119d5568b0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:03.372660 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-79c77815-d1b8-4807-b9c0-f0119d5568b0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:03.379617 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-79c77815-d1b8-4807-b9c0-f0119d5568b0 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1218 microversion: 2.1 time: 0.066395 Jul 05 10:29:03.380200 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 424/847] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:03 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:04.397861 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:04.398543 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:04.406450 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:04.406904 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:04.407815 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:04.408357 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:04.477749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:04.485963 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-42716e43-a604-423d-9dd6-4de9e2a1c5f8 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1276 microversion: 2.1 time: 0.092902 Jul 05 10:29:04.486649 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 424/848] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:04 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:05.503784 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:05.504432 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:05.511926 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:05.512363 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:05.513126 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:05.513552 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:05.619470 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-3c81ce36-14ba-4e93-8e99-1abd2fc3925b req-0b80dcb6-5205-446c-a5da-4b01c400a38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c796bdfd-a625-470f-9f5c-52a216bf72f8", "tag": "f301fd6d-e535-4e7f-9b65-2825982d59ba"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:05.629210 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-3c81ce36-14ba-4e93-8e99-1abd2fc3925b req-0b80dcb6-5205-446c-a5da-4b01c400a38b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:05.629867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-3c81ce36-14ba-4e93-8e99-1abd2fc3925b req-0b80dcb6-5205-446c-a5da-4b01c400a38b service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:05.646244 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-3c81ce36-14ba-4e93-8e99-1abd2fc3925b req-0b80dcb6-5205-446c-a5da-4b01c400a38b service nova] Creating event network-changed:f301fd6d-e535-4e7f-9b65-2825982d59ba for instance c796bdfd-a625-470f-9f5c-52a216bf72f8 on hv-cinder-maste Jul 05 10:29:05.651575 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-3c81ce36-14ba-4e93-8e99-1abd2fc3925b req-0b80dcb6-5205-446c-a5da-4b01c400a38b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036154 Jul 05 10:29:05.652433 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 425/849] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:29:05.653951 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:05.663595 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d7ddf489-2c20-4c81-8099-c0b693536c3e tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.163513 Jul 05 10:29:05.664240 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 425/850] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:05 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:06.686561 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:06.687734 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:06.698618 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:06.699764 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:06.701042 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:06.701773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:06.835973 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:06.843906 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-aed9379b-2e12-445f-844a-23b019658558 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.165143 Jul 05 10:29:06.844482 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 426/851] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:06 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:07.864666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:07.865308 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:07.875688 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:07.876292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:07.877434 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:07.878028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:08.022745 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:08.030252 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-46a33a0e-b7d7-40d7-8062-8cb34aef9287 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.171764 Jul 05 10:29:08.030833 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 426/852] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:07 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:09.048467 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:09.049158 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:09.057733 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:09.058322 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:09.059266 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:09.059777 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:09.062882 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:09.192318 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:09.200547 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e88bc824-a815-4ac8-9855-c23e5a583537 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.157066 Jul 05 10:29:09.201089 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 427/853] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:09 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:10.209146 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-2f20f75c-4f2d-4f5f-bf1c-789318156385 req-5040cd1a-b8a3-431b-a666-4b72e829f19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c796bdfd-a625-470f-9f5c-52a216bf72f8", "name": "network-vif-plugged", "status": "completed", "tag": "f301fd6d-e535-4e7f-9b65-2825982d59ba"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:10.218642 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:10.219251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:10.219460 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-2f20f75c-4f2d-4f5f-bf1c-789318156385 req-5040cd1a-b8a3-431b-a666-4b72e829f19a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:10.219950 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-2f20f75c-4f2d-4f5f-bf1c-789318156385 req-5040cd1a-b8a3-431b-a666-4b72e829f19a service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:10.223344 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:10.226867 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:10.227478 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:10.228416 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:10.229208 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:10.233275 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-2f20f75c-4f2d-4f5f-bf1c-789318156385 req-5040cd1a-b8a3-431b-a666-4b72e829f19a service nova] Creating event network-vif-plugged:f301fd6d-e535-4e7f-9b65-2825982d59ba for instance c796bdfd-a625-470f-9f5c-52a216bf72f8 on hv-cinder-maste Jul 05 10:29:10.239035 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-2f20f75c-4f2d-4f5f-bf1c-789318156385 req-5040cd1a-b8a3-431b-a666-4b72e829f19a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033798 Jul 05 10:29:10.239930 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 427/854] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:29:10.374623 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:10.382294 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-e269ce88-a1f4-4d15-a5a1-90f3ed01f528 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.168527 Jul 05 10:29:10.382876 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 428/855] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:10 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:11.405068 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:11.405772 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:11.414209 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:11.414767 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:11.415581 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:11.416060 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:11.554085 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:11.562369 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-dce41c7c-86e0-46a9-a58a-97ad53b1f8d4 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1318 microversion: 2.1 time: 0.164729 Jul 05 10:29:11.562938 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 428/856] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:11 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:12.581255 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:12.581909 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:12.591328 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:12.591925 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:12.592979 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:12.594264 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:12.729160 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:12.736962 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-4c8d1a8f-d838-4d88-9019-8348502209d1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1508 microversion: 2.1 time: 0.160671 Jul 05 10:29:12.737520 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 429/857] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:12 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:12.755293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de256fa4-6a13-4c43-a696-1d91370b8609", "device": "/dev/sdb"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:12.756419 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:12.763979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:12.764425 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:12.765226 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:12.765682 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:13.046608 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6df872dc-0738-4d56-b4cb-4df741847845 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "POST /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296682 Jul 05 10:29:13.047146 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 429/858] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:29:12 2022] POST /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:29:14.706773 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:29:14.707813 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:29:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:29:15.619677 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:15.620421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:15.674028 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "de256fa4-6a13-4c43-a696-1d91370b8609", "create_info": {"type": "qcow2", "new_file": "volume-de256fa4-6a13-4c43-a696-1d91370b8609.d37998ad-adba-418d-b696-98fc15cdc1fd.vhdx", "snapshot_id": "d37998ad-adba-418d-b696-98fc15cdc1fd"}}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:15.676063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:15.676498 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:15.685086 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:15.685517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:15.699872 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-6ee87aee-b82c-4fe7-8705-4d7adb6680ac req-f56fe32d-8bc2-4b0e-a4f3-946d9978a471 admin admin] 10.222.0.39 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.084727 Jul 05 10:29:15.700493 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 430/859] 10.222.0.39 () {64 vars in 1326 bytes} [Tue Jul 5 10:29:15 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:29:18.944015 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:18.996696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "de256fa4-6a13-4c43-a696-1d91370b8609", "create_info": {"type": "qcow2", "new_file": "volume-de256fa4-6a13-4c43-a696-1d91370b8609.a02c7a72-2fe3-4792-a9c8-156c70de756a.vhdx", "snapshot_id": "a02c7a72-2fe3-4792-a9c8-156c70de756a"}}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:18.998865 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:18.999474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:19.010814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:19.011450 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:19.027219 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-39326fef-aed6-4f11-b911-d963115f8586 req-d1c41936-2602-44a9-85cd-12d5af16aa67 admin admin] 10.222.0.39 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.084299 Jul 05 10:29:19.027837 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 430/860] 10.222.0.39 () {64 vars in 1326 bytes} [Tue Jul 5 10:29:18 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:29:22.095000 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:22.097090 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:22.097537 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:22.107164 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:22.107607 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:22.121934 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-253ac0c5-2752-4356-b28d-5625ee77a851 req-2f538dcc-3096-4f06-bbd6-7f2bc466269b admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a02c7a72-2fe3-4792-a9c8-156c70de756a?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.a02c7a72-2fe3-4792-a9c8-156c70de756a.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.079051 Jul 05 10:29:22.122624 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 431/861] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:29:22 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a02c7a72-2fe3-4792-a9c8-156c70de756a?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.a02c7a72-2fe3-4792-a9c8-156c70de756a.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:29:26.304921 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:26.356980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:26.359011 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:26.359448 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:26.367916 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:26.368348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:26.382074 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-f999ad40-dd4a-42a5-8171-c327f9eefcb3 req-04a125a3-90ca-4d20-8065-0b981a738fe5 admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/989bd621-35a3-4dba-aec9-6cf2c88d6799?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.989bd621-35a3-4dba-aec9-6cf2c88d6799.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.078388 Jul 05 10:29:26.382779 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 431/862] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:29:26 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/989bd621-35a3-4dba-aec9-6cf2c88d6799?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.989bd621-35a3-4dba-aec9-6cf2c88d6799.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:29:30.506266 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:30.564939 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:30.567040 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:30.567475 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:30.576762 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:30.577200 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:30.590906 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-0487182d-577a-4792-a82d-cbd36c1b934e req-bd9bea8c-1768-4fdf-9c45-40b48c746083 admin admin] 10.222.0.39 "DELETE /compute/v2.1/os-assisted-volume-snapshots/d37998ad-adba-418d-b696-98fc15cdc1fd?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.d37998ad-adba-418d-b696-98fc15cdc1fd.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.089280 Jul 05 10:29:30.591520 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 432/863] 10.222.0.39 () {62 vars in 1800 bytes} [Tue Jul 5 10:29:30 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/d37998ad-adba-418d-b696-98fc15cdc1fd?delete_info=%7B%22file_to_merge%22:%20%22volume-de256fa4-6a13-4c43-a696-1d91370b8609.d37998ad-adba-418d-b696-98fc15cdc1fd.vhdx%22,%20%22volume_id%22:%20%22de256fa4-6a13-4c43-a696-1d91370b8609%22%7D => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:29:33.517857 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:33.518522 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:33.525340 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:33.525790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:33.526592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:33.527032 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:33.608741 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lazy-loading 'services' on Instance uuid c796bdfd-a625-470f-9f5c-52a216bf72f8 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:29:33.681787 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-458c35b9-ca51-44af-a203-068ca2c17fb5 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8/os-volume_attachments/de256fa4-6a13-4c43-a696-1d91370b8609" status: 202 len: 0 microversion: 2.1 time: 0.168807 Jul 05 10:29:33.682438 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 432/864] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:29:33 2022] DELETE /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8/os-volume_attachments/de256fa4-6a13-4c43-a696-1d91370b8609 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:29:34.804419 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:34.804997 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:34.812199 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:34.812646 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:34.813421 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:34.813852 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:34.841099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:29:35.079129 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-87694b63-77b1-43ab-b979-1fe92fbea43a tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 204 len: 0 microversion: 2.1 time: 0.279306 Jul 05 10:29:35.079714 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 433/865] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:29:34 2022] DELETE /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:29:35.089216 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:35.089908 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:35.096293 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:35.096739 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:35.097491 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:35.097926 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:35.242084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:35.250065 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-787aa273-5e7b-4d23-9315-78b466f28ef1 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1514 microversion: 2.1 time: 0.165689 Jul 05 10:29:35.250655 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 433/866] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:35 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:36.272687 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:36.273876 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:36.284733 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:36.285444 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:36.286773 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:36.287549 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:36.425251 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:36.434583 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-6bd22b89-5796-40dc-8d74-9aa0d533f197 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1514 microversion: 2.1 time: 0.169063 Jul 05 10:29:36.435149 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 434/867] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:36 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:37.456981 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:37.457709 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:37.460612 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=4 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:37.466387 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:37.466835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:37.467590 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:37.468021 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:37.601358 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:37.612301 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-55eb6f13-1360-4865-98a3-bef766c37f39 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1514 microversion: 2.1 time: 0.160174 Jul 05 10:29:37.613084 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 434/868] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:37 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:38.634482 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:38.635477 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:38.646292 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:38.647080 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:38.648335 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:38.649049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:38.787013 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:38.795098 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d9bec730-ab6f-4ae7-bce3-643ad9e2e103 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1514 microversion: 2.1 time: 0.167412 Jul 05 10:29:38.795655 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 435/869] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:38 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:39.816289 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:39.817286 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:39.828591 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:39.829329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:39.830724 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:39.831435 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:39.965961 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7715154f39dc457695d5991dac30e107', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dccedf0b40e94111bf3b31f9347dfa44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:29:39.973961 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-356ee4c0-f5d3-45f7-91e9-f537091d1e73 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 200 len: 1514 microversion: 2.1 time: 0.164096 Jul 05 10:29:39.974581 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 435/870] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:39 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:29:40.437665 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-4a0ae912-c913-4f25-a2d0-c04b8e29fb54 req-ac2ecf6f-0006-4032-bc74-0c801cb7fec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c796bdfd-a625-470f-9f5c-52a216bf72f8", "name": "network-vif-deleted", "tag": "f301fd6d-e535-4e7f-9b65-2825982d59ba"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:29:40.447224 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4a0ae912-c913-4f25-a2d0-c04b8e29fb54 req-ac2ecf6f-0006-4032-bc74-0c801cb7fec5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:40.447927 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-4a0ae912-c913-4f25-a2d0-c04b8e29fb54 req-ac2ecf6f-0006-4032-bc74-0c801cb7fec5 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:40.452054 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:29:40.460097 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-4a0ae912-c913-4f25-a2d0-c04b8e29fb54 req-ac2ecf6f-0006-4032-bc74-0c801cb7fec5 service nova] Creating event network-vif-deleted:f301fd6d-e535-4e7f-9b65-2825982d59ba for instance c796bdfd-a625-470f-9f5c-52a216bf72f8 on hv-cinder-maste Jul 05 10:29:40.465378 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-4a0ae912-c913-4f25-a2d0-c04b8e29fb54 req-ac2ecf6f-0006-4032-bc74-0c801cb7fec5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031414 Jul 05 10:29:40.465980 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 436/871] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 05 10:29:40.991063 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:29:40.991674 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] [instance: c796bdfd-a625-470f-9f5c-52a216bf72f8] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:29:40.998705 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:40.999145 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:40.999899 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:29:41.000324 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:29:41.015564 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] HTTP exception thrown: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Request method failure captured: Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 HTTP/1.1 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBIkm2EMA5QkzYe1Li4GCqH2tjwmcsDLqS-1u_1IgUWMyaAHrB9W48Vr_4wVsbPEFmo7XnEAK9lE4nETNKCmKHDg13CTrJqG0XhSQyMT9J8aQrjU-2ToeNzPkeoUV43v4gezUzFUVlce2NP8IBQeYG8YHl8H1qcpjLh1-Q9LcoFbXVg Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: dccedf0b40e94111bf3b31f9347dfa44 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:29:41.017163 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dccedf0b40e94111bf3b31f9347dfa44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: dccedf0b40e94111bf3b31f9347dfa44 Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-127185397 Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-VolumesSnapshotTestJSON-127185397-project Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 7715154f39dc457695d5991dac30e107 Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-VolumesSnapshotTestJSON-127185397-project Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. Jul 05 10:29:41.018905 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': 'c796bdfd-a625-470f-9f5c-52a216bf72f8'} Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:29:41.019883 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. Jul 05 10:29:41.022176 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:29:41.023712 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] Returning 404 to user: Instance c796bdfd-a625-470f-9f5c-52a216bf72f8 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:29:41.023712 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-7b941dab-eb78-4a64-9ad0-99c4f80d93d7 tempest-VolumesSnapshotTestJSON-127185397 tempest-VolumesSnapshotTestJSON-127185397-project] 10.222.0.16 "GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8" status: 404 len: 111 microversion: 2.1 time: 0.031449 Jul 05 10:29:41.023712 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 436/872] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:29:40 2022] GET /compute/v2.1/servers/c796bdfd-a625-470f-9f5c-52a216bf72f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 10:30:27.124118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=6 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:27.125753 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:27.130005 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'create', calling method: .version_select at 0x7ffbeaffc040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1973618738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGK8NyGVdVLWIai+aQe3hWd97/ih2QWZiMMegs3nLYcN3TkDVIvSbencqeawwrxtoSbn7GpBA0pCiIFg1yaaS3fzyzpanCKS6k49NwZRd2qNirfD4ens4Jcbh36AB7pi+Q=="}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:30:27.147114 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Getting quotas for project 2613d243336f4fbb97c64ac93139135f. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:30:27.151106 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.quota [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Getting quotas for user 1ce2fa3f26e247c5a96a660ea5a0037a and project 2613d243336f4fbb97c64ac93139135f. Resources: {'key_pairs'} {{(pid=117865) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:30:27.163057 dv-cinder-master-3-smb devstack@n-api.service[117865]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [9f828a92-e244-49c8-a06a-fd5329ffb7e1] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 05 10:30:28.170937 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [9f828a92-e244-49c8-a06a-fd5329ffb7e1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40598. Jul 05 10:30:28.191921 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c06fb1a2-f8d0-4e55-bddb-72b363906a6e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.068794 Jul 05 10:30:28.192553 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 437/873] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Jul 5 10:30:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:30:28.243028 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-996104778", "imageRef": "91129598-dea1-416e-bcf4-b239f4e40313", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1973618738", "networks": [{"uuid": "7b220cce-e5c0-4ee6-ab84-96044e5ed245"}]}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:30:28.249814 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:28.250498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:28.298113 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.network.neutron [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] validate_networks() for [('7b220cce-e5c0-4ee6-ab84-96044e5ed245', None, None, None, None, None)] {{(pid=117864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 05 10:30:28.770461 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Flavor limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 05 10:30:28.770876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Image limits 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 05 10:30:28.771337 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Flavor pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 05 10:30:28.771791 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Image pref 0:0:0 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 05 10:30:28.772143 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.virt.hardware [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 05 10:30:28.782756 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:28.783186 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:28.783965 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:28.784384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:28.800697 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Getting quotas for project 2613d243336f4fbb97c64ac93139135f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 05 10:30:28.804647 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.quota [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Getting quotas for user 1ce2fa3f26e247c5a96a660ea5a0037a and project 2613d243336f4fbb97c64ac93139135f. Resources: {'instances', 'ram', 'cores'} {{(pid=117864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 05 10:30:28.815586 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Going to run 1 instances... {{(pid=117864) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 05 10:30:28.817746 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91129598-dea1-416e-bcf4-b239f4e40313',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 05 10:30:28.869900 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-3d18b6e9-df6a-418b-b1b8-49755a0b1ac7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630871 Jul 05 10:30:28.870590 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 437/874] 10.222.0.16 () {60 vars in 1146 bytes} [Tue Jul 5 10:30:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 05 10:30:28.880654 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-19b53e3b-0182-4230-9657-152dc30971d3 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:28.881563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-19b53e3b-0182-4230-9657-152dc30971d3 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:28.939403 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-19b53e3b-0182-4230-9657-152dc30971d3 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:28.946842 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-19b53e3b-0182-4230-9657-152dc30971d3 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1258 microversion: 2.1 time: 0.070147 Jul 05 10:30:28.947443 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 438/875] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:28 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:29.964931 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-074e767d-e600-421e-a406-551b8590a5ff tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:29.965498 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-074e767d-e600-421e-a406-551b8590a5ff tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:30.024136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-074e767d-e600-421e-a406-551b8590a5ff tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:30.033943 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-074e767d-e600-421e-a406-551b8590a5ff tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1258 microversion: 2.1 time: 0.073582 Jul 05 10:30:30.034786 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 438/876] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:29 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:31.055584 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-743c4dc7-c7eb-4623-a095-1ca9181981b1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:31.056183 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-743c4dc7-c7eb-4623-a095-1ca9181981b1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:31.110875 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-743c4dc7-c7eb-4623-a095-1ca9181981b1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:31.118077 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-743c4dc7-c7eb-4623-a095-1ca9181981b1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1258 microversion: 2.1 time: 0.066374 Jul 05 10:30:31.128471 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 439/877] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:31 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:32.139970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-6ad0597b-62f5-4818-b44a-f247b40950fb tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:32.140979 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-6ad0597b-62f5-4818-b44a-f247b40950fb tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:32.198532 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-6ad0597b-62f5-4818-b44a-f247b40950fb tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:32.205533 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-6ad0597b-62f5-4818-b44a-f247b40950fb tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1258 microversion: 2.1 time: 0.072507 Jul 05 10:30:32.206096 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 439/878] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:32 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:33.223459 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:33.224063 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:33.231886 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:33.232336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:33.233111 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:33.234120 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:33.297336 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:33.305325 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-9a7c428c-053d-4842-b91a-efeba0734928 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1262 microversion: 2.1 time: 0.085825 Jul 05 10:30:33.306328 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 440/879] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:33 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:34.325876 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:34.326534 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:34.337461 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:34.338188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:34.339018 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:34.339463 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:34.428650 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:34.442778 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f17aac99-44c3-405f-b13d-f6a0ac8d3317 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1316 microversion: 2.1 time: 0.122509 Jul 05 10:30:34.452798 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 440/880] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:34 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1316 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:35.461092 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:35.462394 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:35.469834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:35.471508 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:35.472493 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:35.472948 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:35.619369 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:35.631802 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-69f5d4d0-416d-46fa-91fe-1d90ad20e2e4 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.174903 Jul 05 10:30:35.638605 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 441/881] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:35 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:36.652408 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:36.656173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:36.664033 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:36.664471 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:36.665229 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:36.665657 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:36.823181 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:36.833803 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d49f69d8-9cd7-479d-81ad-2b628fb82129 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.188132 Jul 05 10:30:36.839744 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 441/882] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:36 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:37.852041 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:37.854766 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:37.861847 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:37.862364 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:37.863158 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:37.863608 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:38.017289 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:38.025447 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-858cc73a-b601-4c2e-95db-00e22f656f1c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.177667 Jul 05 10:30:38.026269 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 442/883] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:37 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:39.044176 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:39.044774 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:39.047793 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=2 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:39.060883 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:39.066173 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:39.067350 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:39.067787 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:39.232731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:39.247845 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-aed00da3-c3cd-493a-a44d-43e2f82612ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.208519 Jul 05 10:30:39.252645 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 442/884] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:39 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:40.269299 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:40.269910 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:40.277883 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:40.278422 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:40.279189 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:40.279622 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:40.428388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:40.438114 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-c4ea3c96-a961-4318-8b93-e26272b944ae tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.172732 Jul 05 10:30:40.440113 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 443/885] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:40 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:41.460329 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:41.461060 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:41.469400 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:41.470100 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:41.471333 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:41.472034 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:41.671706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:41.676680 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-364e78ae-a888-42b6-acc0-ad1f0b8ea3a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.222980 Jul 05 10:30:41.678265 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 443/886] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:41 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:42.691963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=8 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:42.702325 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:42.702975 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:42.709567 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:42.710116 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:42.711031 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:42.711462 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:42.853603 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:42.861379 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-82c971b9-9825-44f6-8947-1c29f556bbb1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.170218 Jul 05 10:30:42.870794 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 444/887] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:42 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:43.881980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:43.883023 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:43.886084 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell0:SELECT=10 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:43.896259 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:43.896854 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:43.897785 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:43.898685 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:44.032292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:44.040173 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-395a8a6e-d4d9-4283-82ea-279bddc111f7 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.164627 Jul 05 10:30:44.040770 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 444/888] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:43 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:45.057927 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:45.058571 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:45.068990 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:45.069456 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:45.070950 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:45.071426 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:45.209756 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:45.220474 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f9102bd9-fa97-45b5-b709-a3d61d0518ef tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.166728 Jul 05 10:30:45.221296 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 445/889] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:45 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:46.244019 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:46.244625 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:46.253761 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:46.254254 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:46.255030 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:46.255481 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:46.388564 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:46.404042 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-8df0ba85-802d-4843-941d-570413aa5dc2 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.165670 Jul 05 10:30:46.404706 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 445/890] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:46 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:46.752806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-74692675-74e3-4fbe-be25-c5e11fea6c85 req-f97f8161-5280-4301-90d9-b53489b0cfab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:30:46.762214 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-74692675-74e3-4fbe-be25-c5e11fea6c85 req-f97f8161-5280-4301-90d9-b53489b0cfab service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:46.762387 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-74692675-74e3-4fbe-be25-c5e11fea6c85 req-f97f8161-5280-4301-90d9-b53489b0cfab service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:46.773954 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-74692675-74e3-4fbe-be25-c5e11fea6c85 req-f97f8161-5280-4301-90d9-b53489b0cfab service nova] Creating event network-changed:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:30:46.779303 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-74692675-74e3-4fbe-be25-c5e11fea6c85 req-f97f8161-5280-4301-90d9-b53489b0cfab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165472 Jul 05 10:30:46.779922 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 446/891] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:30:47.424900 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:47.425805 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:47.433803 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:47.434245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:47.435027 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:47.435459 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:47.567154 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:47.575015 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-769228b7-d478-4045-bad1-be0736739b25 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.157544 Jul 05 10:30:47.575616 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 446/892] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:47 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:48.598185 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:48.599392 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:48.610267 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:48.611014 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:48.612280 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:48.612998 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:48.763783 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:48.771606 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-189870ea-f020-4760-b9b0-39d41ee6b3fd tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.181141 Jul 05 10:30:48.772191 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 447/893] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:48 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:49.789258 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:49.789847 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:49.796861 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:49.797302 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:49.798047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:49.798591 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:49.937347 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:49.945570 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b74aea15-5b38-4557-a1f6-4adc43b15ffe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.160163 Jul 05 10:30:49.946123 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 447/894] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:49 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:50.969446 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:50.970190 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:50.978841 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:50.979370 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:50.980342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:50.980900 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:51.113845 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:51.121616 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ac27a863-fa37-4f7a-8c80-081651c334e8 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.157174 Jul 05 10:30:51.122191 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 448/895] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:50 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:52.143268 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:52.144151 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:52.155265 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:52.156035 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:52.157348 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:52.158067 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:52.287538 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:52.295746 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-9e2e1931-c557-4c06-8db5-edab5cddb1a5 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.159118 Jul 05 10:30:52.296320 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 448/896] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:52 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:53.312243 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:53.312834 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:53.319526 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:53.319969 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:53.321056 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:53.321669 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:53.453079 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:53.461382 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-11faed71-9a41-4fd2-993a-ad0623a1f499 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.153193 Jul 05 10:30:53.461954 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 449/897] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:53 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:54.482701 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:54.483665 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:54.495046 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:54.495782 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:54.497052 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:54.497768 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:54.637792 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:54.645523 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-df4b65af-d550-4d1d-bc0f-e81505786d6b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.169419 Jul 05 10:30:54.646124 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 449/898] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:54 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:54.771992 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-8d73c743-550c-4085-ac51-73b774aafa7a req-c10751a2-892a-4fb0-81e9-fbd10779f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "name": "network-vif-plugged", "status": "completed", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:30:54.780275 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8d73c743-550c-4085-ac51-73b774aafa7a req-c10751a2-892a-4fb0-81e9-fbd10779f3f8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:54.780712 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-8d73c743-550c-4085-ac51-73b774aafa7a req-c10751a2-892a-4fb0-81e9-fbd10779f3f8 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:54.791499 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-8d73c743-550c-4085-ac51-73b774aafa7a req-c10751a2-892a-4fb0-81e9-fbd10779f3f8 service nova] Creating event network-vif-plugged:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:30:54.796212 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-8d73c743-550c-4085-ac51-73b774aafa7a req-c10751a2-892a-4fb0-81e9-fbd10779f3f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089988 Jul 05 10:30:54.796791 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 450/899] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:30:55.666764 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:55.667630 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:55.676632 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:55.677069 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:55.677821 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:55.678245 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:55.811872 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:55.820310 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-bd3fc80d-0fa1-4cf6-9f15-0f578efa5e05 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1358 microversion: 2.1 time: 0.159884 Jul 05 10:30:55.820911 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 450/900] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:55 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:56.843340 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:56.844350 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:56.851517 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:56.851962 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:56.852729 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:56.853166 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.248044 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:57.249940 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=64 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:57.257122 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-a1a61627-fb6a-4637-9601-273480d9a81b tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1549 microversion: 2.1 time: 0.421865 Jul 05 10:30:57.257689 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 451/901] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:56 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1549 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:57.273506 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:57.274127 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:57.281069 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.281513 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.282297 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.282731 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.410766 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:57.418638 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-acaa7768-6aff-4754-817f-01d398b04efe tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1549 microversion: 2.1 time: 0.148997 Jul 05 10:30:57.419216 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 451/902] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:57 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:57.434827 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:57.438257 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:57.439174 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Searching by: {'deleted': False, 'project_id': '2613d243336f4fbb97c64ac93139135f'} {{(pid=117865) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 05 10:30:57.441195 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:30:57.447701 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.448154 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.448964 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.449394 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.540488 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.multi_cell_list [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117865) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 05 10:30:57.635338 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f25a338e-ae6b-479d-9e3c-3fea18681019 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204303 Jul 05 10:30:57.635915 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 452/903] 10.222.0.16 () {58 vars in 1124 bytes} [Tue Jul 5 10:30:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:30:57.649411 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:30:57.650418 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:57.659160 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.659595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.660344 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:57.660769 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:57.791948 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:30:57.801982 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-b92342a4-26b8-489b-9e70-e013d1bd2d9c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1549 microversion: 2.1 time: 0.158938 Jul 05 10:30:57.802594 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 452/904] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:30:57 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:30:59.360963 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c3ec9e-de98-4189-bc39-ebd8f4ec9773"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:30:59.362034 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:30:59.368940 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:59.369388 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:59.370156 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:30:59.370632 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:30:59.642015 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-135b9edf-c155-4f62-b813-8c2361c332a9 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284981 Jul 05 10:30:59.642641 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 453/905] 10.222.0.16 () {60 vars in 1322 bytes} [Tue Jul 5 10:30:59 2022] POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:31:01.940568 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:31:01.941131 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:31:01.943595 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:31:01.949971 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:01.950506 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:01.951284 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:01.951706 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:01.954769 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=81 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:31:02.088064 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:31:02.096275 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-d3fd5924-5d9a-4911-861e-31d0557f0132 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1595 microversion: 2.1 time: 0.159613 Jul 05 10:31:02.096846 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 453/906] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:31:01 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:31:03.802342 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-9bec6a56-26fe-462f-a415-fe63b95cf368 req-35107b69-b85f-43a2-8ee6-3568cb6404fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:31:03.811148 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9bec6a56-26fe-462f-a415-fe63b95cf368 req-35107b69-b85f-43a2-8ee6-3568cb6404fa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:03.811597 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-9bec6a56-26fe-462f-a415-fe63b95cf368 req-35107b69-b85f-43a2-8ee6-3568cb6404fa service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:03.823774 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-9bec6a56-26fe-462f-a415-fe63b95cf368 req-35107b69-b85f-43a2-8ee6-3568cb6404fa service nova] Creating event network-changed:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:31:03.828872 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-9bec6a56-26fe-462f-a415-fe63b95cf368 req-35107b69-b85f-43a2-8ee6-3568cb6404fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031268 Jul 05 10:31:03.829869 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 454/907] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:31:04.880291 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-940777439"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:31:04.880977 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:31:04.887796 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:04.888317 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:04.889136 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:04.889634 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:05.028798 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.network.security_group_api [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Adding security group 01c55f6d-f852-4ab6-8884-65d5a2a600a6 to port 1f1258f5-d6eb-4b78-a157-98a6e36ed330 Jul 05 10:31:05.376939 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-46eaec12-3d40-4e2e-9a2b-e9f270a02efc tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action" status: 202 len: 0 microversion: 2.1 time: 0.500642 Jul 05 10:31:05.378020 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 454/908] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:31:04 2022] POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:31:05.387903 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:31:05.387903 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:31:05.408006 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:05.410307 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:05.411110 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:05.412118 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:05.461606 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-0b9a4262-b439-427a-9124-6c0165f3f186 req-1edacdf0-fdd5-4f25-a39c-a94d89aff170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:31:05.474438 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0b9a4262-b439-427a-9124-6c0165f3f186 req-1edacdf0-fdd5-4f25-a39c-a94d89aff170 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:31:05.475086 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-0b9a4262-b439-427a-9124-6c0165f3f186 req-1edacdf0-fdd5-4f25-a39c-a94d89aff170 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:31:05.487893 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-0b9a4262-b439-427a-9124-6c0165f3f186 req-1edacdf0-fdd5-4f25-a39c-a94d89aff170 service nova] Creating event network-changed:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:31:05.494738 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-0b9a4262-b439-427a-9124-6c0165f3f186 req-1edacdf0-fdd5-4f25-a39c-a94d89aff170 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110503 Jul 05 10:31:05.495972 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 455/909] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:31:05.589513 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:31:05.599380 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1031b07b-08fe-4252-835f-281a4a091dd6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1759 microversion: 2.1 time: 0.217546 Jul 05 10:31:05.603707 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 455/910] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:31:05 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1759 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:07.340853 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell0:SELECT=2 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:32:07.342025 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=7 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:32:07.343114 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:32:07.350147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:32:07.351574 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:07.362999 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:07.363608 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:07.364749 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:07.365181 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:07.441307 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-727cf4fa-51f2-4254-8db1-b9b17709b2c1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action" status: 202 len: 0 microversion: 2.1 time: 0.102907 Jul 05 10:32:07.441960 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 456/911] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:32:07 2022] POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:32:07.448527 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=5 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:32:07.449309 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=15 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:32:07.453228 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:07.453835 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:07.460873 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:07.461316 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:07.462082 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:07.462531 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:07.607441 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:07.615562 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5362f701-b25f-4fad-93f6-8d0da8810436 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1751 microversion: 2.1 time: 0.168746 Jul 05 10:32:07.616170 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 456/912] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:07 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:08.638368 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:08.639599 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:08.649140 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:08.649580 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:08.650374 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:08.650806 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:08.810110 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:08.821917 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f2eb5e33-1021-4a9a-a8a4-7f22135e79d1 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.190916 Jul 05 10:32:08.822528 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 457/913] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:08 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:09.843838 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:09.844882 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:09.854622 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:09.855070 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:09.855828 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:09.856260 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:10.001248 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:10.009419 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-0e3bb43b-2a51-472c-bdb1-d533aa39428a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.172257 Jul 05 10:32:10.010010 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 457/914] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:09 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:11.028161 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:11.028792 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:11.036099 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:11.036556 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:11.037313 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:11.037739 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:11.191427 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:11.201166 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-ea38f8e2-59de-45e9-9c02-24c1f5452a5c tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.177215 Jul 05 10:32:11.201741 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 458/915] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:11 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:12.222809 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:12.223675 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:12.234696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:12.235425 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:12.236666 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:12.237376 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:12.383352 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:12.395878 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-c820f5e2-9909-4b3a-9b0d-7796045eaece tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.179461 Jul 05 10:32:12.396619 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 458/916] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:12 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:13.420978 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:13.421563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:13.428717 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:13.429137 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:13.429920 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:13.430389 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:13.582395 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:13.595700 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-8cd00b8d-8fee-48a7-b06c-73c842285078 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.179293 Jul 05 10:32:13.596474 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 459/917] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:13 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:14.621355 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:14.621956 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:14.629150 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:14.629625 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:14.630424 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:14.630856 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:14.787790 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:14.796311 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ea6e4804-484f-41bd-a363-d214e9fd685e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.181712 Jul 05 10:32:14.796898 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 459/918] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:14 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:15.813752 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:15.814356 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:15.821705 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:15.822147 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:15.822967 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:15.823401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:15.979185 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:15.991237 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fbb30c1b-18c4-449d-9ded-6359e5b8606a tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.181254 Jul 05 10:32:15.992026 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 460/919] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:15 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:17.012983 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:17.013734 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:17.021918 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:17.022486 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:17.023384 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:17.023882 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:17.202641 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:17.213823 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-83db2962-8e89-4156-953f-040859dddb19 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.207162 Jul 05 10:32:17.214483 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 460/920] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:17 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:18.235578 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:18.236506 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:18.246896 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:18.247337 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:18.248095 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:18.248507 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:18.398119 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:18.408270 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-fdc81e87-7bd1-4d58-86f7-9c50e4d8d675 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.179519 Jul 05 10:32:18.408837 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 461/921] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:18 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:19.431251 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:19.432292 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:19.442499 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:19.443201 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:19.444477 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:19.445184 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:19.619725 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:19.628062 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-5613cbae-7e63-4bef-97da-e6f4e4a09280 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1756 microversion: 2.1 time: 0.204176 Jul 05 10:32:19.628614 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 461/922] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:19 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:20.649978 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:32:20.651026 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:32:20.659349 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:20.659846 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:20.660693 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:32:20.661173 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:32:20.812652 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:32:20.825464 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-86f3f6ff-499d-421f-8f7e-4136c78ad49f tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1759 microversion: 2.1 time: 0.182036 Jul 05 10:32:20.826077 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 462/923] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:32:20 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:32:39.766299 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:32:39.767146 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:33:24.247225 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_api:SELECT=12 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:33:24.248454 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG dbcounter [-] [117864] Writing DB stats nova_cell1:SELECT=36 {{(pid=117864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:33:24.255388 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-940777439"}} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:33:24.256265 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:24.267683 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:24.268472 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:24.269746 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:24.270353 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:24.608698 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.network.security_group_api [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Removing security group 01c55f6d-f852-4ab6-8884-65d5a2a600a6 from port 1f1258f5-d6eb-4b78-a157-98a6e36ed330 Jul 05 10:33:24.957766 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-e82aebe5-911b-43c4-a7b9-7a5a094b9107 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action" status: 202 len: 0 microversion: 2.1 time: 0.713372 Jul 05 10:33:24.958785 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 462/924] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Jul 5 10:33:24 2022] POST /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/action => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:33:24.969401 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_api:SELECT=14 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:33:24.971553 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG dbcounter [-] [117865] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117865) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 10:33:24.983782 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-525a8223-bbfb-4d86-b5f6-f9fd31c61b74 req-518b4348-575b-470c-961f-9f90401dfaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:33:25.016754 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-525a8223-bbfb-4d86-b5f6-f9fd31c61b74 req-518b4348-575b-470c-961f-9f90401dfaf7 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:25.017118 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-525a8223-bbfb-4d86-b5f6-f9fd31c61b74 req-518b4348-575b-470c-961f-9f90401dfaf7 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:25.035482 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-525a8223-bbfb-4d86-b5f6-f9fd31c61b74 req-518b4348-575b-470c-961f-9f90401dfaf7 service nova] Creating event network-changed:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:33:25.043821 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-525a8223-bbfb-4d86-b5f6-f9fd31c61b74 req-518b4348-575b-470c-961f-9f90401dfaf7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076233 Jul 05 10:33:25.045782 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 463/925] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:33:26.086515 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:26.087102 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:26.093062 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:26.093499 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:26.094335 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:26.094754 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:26.174188 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.objects.instance [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lazy-loading 'services' on Instance uuid 369fb296-5ae3-40a5-ac49-8f9129f73962 {{(pid=117864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 05 10:33:26.249806 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-f5d0e583-dc70-4118-9e88-12da468f3b84 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments/f4c3ec9e-de98-4189-bc39-ebd8f4ec9773" status: 202 len: 0 microversion: 2.1 time: 0.167699 Jul 05 10:33:26.250560 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 463/926] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:33:26 2022] DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments/f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:33:26.260141 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:26.261146 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:26.268049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:26.268492 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:26.269235 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:26.269938 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:26.300262 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-d4a6332f-1a8e-4b83-a877-e295e4f65ae0 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Jul 05 10:33:26.300835 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 464/927] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:33:26 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:33:27.060724 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [req-3452e06c-22ef-4edf-b5be-5a487a03607b req-84162c00-e2e7-4517-9c77-77fefb06bb48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:33:27.070377 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3452e06c-22ef-4edf-b5be-5a487a03607b req-84162c00-e2e7-4517-9c77-77fefb06bb48 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:27.070980 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [req-3452e06c-22ef-4edf-b5be-5a487a03607b req-84162c00-e2e7-4517-9c77-77fefb06bb48 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:27.082358 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.compute.server_external_events [req-3452e06c-22ef-4edf-b5be-5a487a03607b req-84162c00-e2e7-4517-9c77-77fefb06bb48 service nova] Creating event network-changed:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:33:27.087374 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [req-3452e06c-22ef-4edf-b5be-5a487a03607b req-84162c00-e2e7-4517-9c77-77fefb06bb48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031531 Jul 05 10:33:27.088215 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 464/928] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:33:27.312216 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:27.313601 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:27.320768 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:27.321219 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:27.321993 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:27.322484 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:27.351877 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-b1d0d80d-b145-437a-b5bc-80439b202d53 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043717 Jul 05 10:33:27.357210 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 465/929] 10.222.0.16 () {58 vars in 1301 bytes} [Tue Jul 5 10:33:27 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 05 10:33:27.363213 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:27.363801 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:27.370884 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:27.371350 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:27.372148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:27.372696 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:27.449639 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] HTTP exception thrown: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 is not attached to volume f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Request method failure captured: Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments/f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 HTTP/1.1 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBK06RcJDt6-ev03AAySE1Djt1MhY8DM55qRLm-bQ9baWEqKMRAdVs4ppsbtnOQ069e0iTfCFsj3SuaolFsU-hs69iTZpr0G4pwdaNE-zx3dTjLTOPsXTvY9ct2cfSO19xdKHYQN-rY-NJrg866Q7zPZ-eyFUX9L7sX6Sw5KRzg4xqQ Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 2613d243336f4fbb97c64ac93139135f Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:33:27.452058 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2613d243336f4fbb97c64ac93139135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 2613d243336f4fbb97c64ac93139135f Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-TestMinimumBasicScenario-11801660-project Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 1ce2fa3f26e247c5a96a660ea5a0037a Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-TestMinimumBasicScenario-11801660-project Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:33:27.453747 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 is not attached to volume f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'server_id': '369fb296-5ae3-40a5-ac49-8f9129f73962', 'id': 'f4c3ec9e-de98-4189-bc39-ebd8f4ec9773'} Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4c3ec9e-de98-4189-bc39-ebd8f4ec9773. Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:33:27.454599 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 is not attached to volume f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 is not attached to volume f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:27.455925 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Returning 404 to user: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 is not attached to volume f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:33:27.456976 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-08ed683b-0a1a-46e8-b311-fe5e4b7edb8e tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments/f4c3ec9e-de98-4189-bc39-ebd8f4ec9773" status: 404 len: 154 microversion: 2.1 time: 0.094801 Jul 05 10:33:27.456976 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 465/930] 10.222.0.16 () {58 vars in 1415 bytes} [Tue Jul 5 10:33:27 2022] DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962/os-volume_attachments/f4c3ec9e-de98-4189-bc39-ebd8f4ec9773 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 05 10:33:28.599844 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:28.600363 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:28.607214 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:28.607676 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:28.608468 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:28.608895 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:28.634974 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Going to try to terminate instance {{(pid=117865) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 05 10:33:28.718559 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-76fd40a9-3529-4a72-958b-5225af2e99db tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 204 len: 0 microversion: 2.1 time: 0.122244 Jul 05 10:33:28.719407 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 466/931] 10.222.0.16 () {58 vars in 1238 bytes} [Tue Jul 5 10:33:28 2022] DELETE /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 05 10:33:28.729161 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:28.729871 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:28.741345 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:28.741795 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:28.742609 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:28.743047 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:28.883973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:33:28.891684 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-1ce55dbb-ee40-4837-9df2-6f50a798a488 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1555 microversion: 2.1 time: 0.167281 Jul 05 10:33:28.892208 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 466/932] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:33:28 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:33:29.915704 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:29.916908 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.compute.api [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117865) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:29.927929 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:29.928820 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:29.929609 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:29.930049 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:30.130672 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.policy [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117865) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:33:30.138475 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-f66499b1-3044-424c-b4ed-1875146f4c56 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1555 microversion: 2.1 time: 0.230017 Jul 05 10:33:30.139052 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 467/933] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:33:29 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:33:31.155973 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:31.156592 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:31.163584 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:31.164010 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:31.164831 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:31.165266 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:31.292867 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.policy [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ce2fa3f26e247c5a96a660ea5a0037a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2613d243336f4fbb97c64ac93139135f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117864) authorize /opt/stack/nova/nova/policy.py:199}} Jul 05 10:33:31.300592 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-696728fe-a8a1-4115-be80-2c4dfb794423 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 200 len: 1555 microversion: 2.1 time: 0.148547 Jul 05 10:33:31.301285 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 467/934] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:33:31 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 05 10:33:31.550440 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [req-22c1007f-a587-4bb5-8a45-5c70303801f4 req-72b5bdc5-36a5-461b-ab15-2eebc794cb14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "369fb296-5ae3-40a5-ac49-8f9129f73962", "name": "network-vif-deleted", "tag": "1f1258f5-d6eb-4b78-a157-98a6e36ed330"}]} {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 05 10:33:31.559095 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-22c1007f-a587-4bb5-8a45-5c70303801f4 req-72b5bdc5-36a5-461b-ab15-2eebc794cb14 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:31.559563 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG oslo_concurrency.lockutils [req-22c1007f-a587-4bb5-8a45-5c70303801f4 req-72b5bdc5-36a5-461b-ab15-2eebc794cb14 service nova] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:31.570594 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.compute.server_external_events [req-22c1007f-a587-4bb5-8a45-5c70303801f4 req-72b5bdc5-36a5-461b-ab15-2eebc794cb14 service nova] Creating event network-vif-deleted:1f1258f5-d6eb-4b78-a157-98a6e36ed330 for instance 369fb296-5ae3-40a5-ac49-8f9129f73962 on hv-cinder-maste Jul 05 10:33:31.575690 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [req-22c1007f-a587-4bb5-8a45-5c70303801f4 req-72b5bdc5-36a5-461b-ab15-2eebc794cb14 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029009 Jul 05 10:33:31.576339 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 468/935] 10.222.0.16 () {64 vars in 1317 bytes} [Tue Jul 5 10:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 05 10:33:32.322392 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '>' {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:32.323687 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.compute.api [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] [instance: 369fb296-5ae3-40a5-ac49-8f9129f73962] Fetching instance by UUID {{(pid=117864) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 05 10:33:32.335132 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:32.335970 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:32.337018 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 05 10:33:32.337474 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG oslo_concurrency.lockutils [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Lock "32bbf915-3f68-4e1d-9859-941f6a1419ac" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 05 10:33:32.353583 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.wsgi [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] HTTP exception thrown: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Request method failure captured: Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: request: GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 HTTP/1.1 Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept: application/json Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Accept-Encoding: identity Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Connection: close Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Length: 0 Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Content-Type: application/json Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Host: 10.222.0.16 Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: Openstack-System-Scope: None Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: User-Agent: python-urllib3/1.26.9 Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Auth-Token: gAAAAABixBK06RcJDt6-ev03AAySE1Djt1MhY8DM55qRLm-bQ9baWEqKMRAdVs4ppsbtnOQ069e0iTfCFsj3SuaolFsU-hs69iTZpr0G4pwdaNE-zx3dTjLTOPsXTvY9ct2cfSO19xdKHYQN-rY-NJrg866Q7zPZ-eyFUX9L7sX6Sw5KRzg4xqQ Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Id: None Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Domain-Name: None Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Identity-Status: Confirmed Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Is-Admin-Project: True Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Id: default Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Domain-Name: Default Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Id: 2613d243336f4fbb97c64ac93139135f Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Project-Name: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Role: member,reader Jul 05 10:33:32.355148 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Roles: member,reader Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2613d243336f4fbb97c64ac93139135f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2613d243336f4fbb97c64ac93139135f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}] Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Id: 2613d243336f4fbb97c64ac93139135f Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-11801660 Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User: tempest-TestMinimumBasicScenario-11801660-project Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Id: default Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Domain-Name: Default Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Id: 1ce2fa3f26e247c5a96a660ea5a0037a Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: X-User-Name: tempest-TestMinimumBasicScenario-11801660-project Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: method: > Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: exception: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. Jul 05 10:33:32.356849 dv-cinder-master-3-smb devstack@n-api.service[117864]: action_args: {'id': '369fb296-5ae3-40a5-ac49-8f9129f73962'} Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: {{(pid=117864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 05 10:33:32.357674 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. Jul 05 10:33:32.359052 dv-cinder-master-3-smb devstack@n-api.service[117864]: ERROR nova.api.openstack.wsgi Jul 05 10:33:32.360270 dv-cinder-master-3-smb devstack@n-api.service[117864]: DEBUG nova.api.openstack.wsgi [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Returning 404 to user: Instance 369fb296-5ae3-40a5-ac49-8f9129f73962 could not be found. {{(pid=117864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 05 10:33:32.360270 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO nova.api.openstack.requestlog [None req-ce921106-be27-4afe-b040-43ab1b9a1ea6 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962" status: 404 len: 111 microversion: 2.1 time: 0.041061 Jul 05 10:33:32.360270 dv-cinder-master-3-smb devstack@n-api.service[117864]: [pid: 117864|app: 0|req: 468/936] 10.222.0.16 () {58 vars in 1235 bytes} [Tue Jul 5 10:33:32 2022] GET /compute/v2.1/servers/369fb296-5ae3-40a5-ac49-8f9129f73962 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 05 10:33:32.365781 dv-cinder-master-3-smb devstack@n-api.service[117865]: DEBUG nova.api.openstack.wsgi [None req-1a5c9c8f-b282-424d-b8d4-2a9fa9ba8d23 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] Calling method '.version_select at 0x7ffbf012d5e0>' {{(pid=117865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 05 10:33:32.384939 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO nova.api.openstack.requestlog [None req-1a5c9c8f-b282-424d-b8d4-2a9fa9ba8d23 tempest-TestMinimumBasicScenario-11801660 tempest-TestMinimumBasicScenario-11801660-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1973618738" status: 202 len: 0 microversion: 2.1 time: 0.023325 Jul 05 10:33:32.385504 dv-cinder-master-3-smb devstack@n-api.service[117865]: [pid: 117865|app: 0|req: 469/937] 10.222.0.16 () {58 vars in 1271 bytes} [Tue Jul 5 10:33:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1973618738 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 05 10:34:22.652757 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:34:22.653954 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:35:54.726430 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:35:54.726987 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:35:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:35:59.779771 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:35:59.780425 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:36:14.460299 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:36:14.461333 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:36:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:36:26.483971 dv-cinder-master-3-smb devstack@n-api.service[117864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:36:26.484942 dv-cinder-master-3-smb devstack@n-api.service[117864]: Tue Jul 5 10:36:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 05 10:37:42.666099 dv-cinder-master-3-smb devstack@n-api.service[117865]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 05 10:37:42.666975 dv-cinder-master-3-smb devstack@n-api.service[117865]: Tue Jul 5 10:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!